Troubleshooting Dataflow from different Parties

AS a IT Operator ive got this sceneray:

Data flow:

PERM PurcahseofPackages order ---> MTH PurcahseofPackages ---> Altamira (Recharger OCS) ---> Success

Because i dont have enouh documentation of the flow by rhe vendor I wonder if i can apply any technique or framework to trobleshoot if any issue arises?

Ive been embarrased some situations because dont know the order where to start to tackle the issue,
just from the layer 2 i can test connectivities using ping or traceroute but when talking about checking out web services consumption (have no idea)
What should i do to know ho to check out a web service consumption?

In Order words How can i troubleshoot exactly that the problem is no from PERM but pinpoint the problem is from MTH or Altamira?

PERM
Architecture:
Load Balancer (10.203.216.218 Port 9090)
4 nodes for the application and webserver and 2 nodes for DB:
10.203.216/10-13

Services:
1 Recharges
2 PurcahseofPackages

Parties to interact with:

  • MTH
    Architecture:
    Load Balancer (10.203.y.xx Port 8080)
    4 nodes for the application and 2 nodes for DB:
    10.203.216/10-13

1 Question: How do i checkout or PERM consume this service?

http://10.203.y.xx/MTHService/MTHRemoteServiceRequestFullStack?WSDL

Services:
Combos
● PackageOfferings
● Gifts
● Promotions

  • Altamira
    Architecture:
    Ist a kind of OCS (Online charge System and Billing charger)
    it uses Tuxedos Technology

IP DESTINATION: 10.80.56.xx Altamira
Ports Range:
19051 - 19199
19201 - 19349
19351 - 19499
19501 - 19649

it uses jolt ports
2 Question: what is it a jolt port?
2.1 how can i check out if tuxedo PP_GA_RECHARGE3 is not worjing? can i check its connections?
for instance in a line for a log it calls a tuxedo call

bea.jolt.JoltRemoteService(PP_GA_RECHARGE3)
2019-04-04 10:46:17,838]  [Thread-24491] [42002777] TuxedoHelper$Tuxedo - bea.jolt.JoltRemoteService(PP_GA_RECHARGE3)call()

Validations from SO:

Connections from PERM to Altamira:

java    16425 perm_admin   94u  a_inode               0,13         0      8525 [eventpoll]
java    16425 perm_admin   95u     IPv6          658072385       0t0       TCP localhost:9070->localhost:42094 (ESTABLISHED)
java    16425 perm_admin   96u     IPv6          658073189       0t0       TCP proermpaymweb01.nh.inet:35036->10.80.56.xx:19352 (ESTABLISHED)
Connections from PERM to MTH:
![PurchaseofPackage Dataflow|513x244](upload://oFUQOab5g1UyyEx072T9fxpkLcg.png)

java    13205 perm_admin   94u  a_inode               0,13         0      8525 [eventpoll]
java    13205 perm_admin   95u     IPv6          658072385       0t0       TCP localhost:9070->localhost:42094 (ESTABLISHED)
java    13205 perm_admin   96u     IPv6          658073189       0t0       TCP proermpaymweb01.nh.inet:3503->10.203.xx.yy:8080 httpd (ESTABLISHED)

I appreciate your help and a shed light on this

I Uploaded Dataflow image:

Thanks
PurchaseofPackage Dataflow

Good afternoon, is there any feedback in this scenario?

On apache local-access.logs frpm PERM app dont see errors just 200 response:

127.0.0.1 - - [20/Oct/2023:07:15:52 -0500] "GET /perm-webservices/entity-ws/DAVIVIENDA HTTP/1.1" 200 356
127.0.0.1 - - [20/Oct/2023:07:15:52 -0500] "GET /perm-webservices/settings/get-setting/erm_ws_endpoint_host HTTP/1.1" 200 79
10.203.216.18 - - [20/Oct/2023:07:15:55 -0500] "POST /erm-transaction-service/ERMTransactionService HTTP/1.1" 200 506
127.0.0.1 - - [20/Oct/2023:07:15:56 -0500] "GET /perm-webservices/package-offering/package-query HTTP/1.1" 200 64632

I just want to pinpoint these questions:

1 How do i checkout or consume this service throuh SOAPUI or curl in order to see if MTH is the problem?

[Block Code](http://10.203.5.38/MTHService/MTHRemoteServiceRequestFullStack?WSDL)

When Starting apache I can see the following services being deployed:

/usr/share/tomEE-plus-9.0.60/apache-tomcat-9.0.60/webapps/perm
    TransferLogService
    PromotionRuleService
    OfferingBean
    DistributorTypeService
    LogBean
    CurrencyService
    CreditLimitService
    UpdateCreditLimitLogService
    PromotionService
    TransactionService
  AltamiraOriginService

2 Is there any way to search for their wsdl files and get theit URI?

Having access to Platform Altamira which is the OCS (Online charge System and Billing charger)
it uses Tuxedos Technology

IP DESTINATION: 10.80.56.xx Altamira
Ports Range:
19051 - 19199
19201 - 19349
19351 - 19499
19501 - 19649

Is there any way to see if Tuxedo PP_GA_RECHARGE3 is blocked and how many close_wait connections are taking?

4 by using strace and pid for a process can help me give more visibility what is sending o receiving?
5 by using trace consumes much resources and affects performance of application?

I appreciate your help in advanced

Good afternoon, is any shed light or guidance about these questions

Thanks you for your help in advance