HTTPRequest node

This topic contains the following sections:

Purpose

Use the HTTPRequest node to interact with a Web service, using all or part of the input message as the request sent to that service. You can also configure the node to create a new output message from the contents of the input message augmented by the contents of the Web service response before you propagate the message to subsequent nodes in the message flow.

Depending on the configuration, this node constructs an HTTP or an HTTP over SSL (HTTPS) request from the specified contents of the input message and sends this to the Web service. It receives the response from the Web service, and parses the response for inclusion in the output tree. It generates HTTP headers if these are required by your configuration.

You can use this node in a message flow that does not contain an HTTPInput or HTTPReply node.

The HTTPRequest node handles messages in the following message domains:

  • MRM
  • XML
  • XMLNS
  • XMLNSC
  • JMSMap
  • JMSStream
  • MIME
  • BLOB
  • IDOC

The HTTPRequest node is represented in the workbench by the following icon:

HTTPRequest node icon

Using this node in a message flow

The HTTPRequest node can be used in any message flow that needs to send an HTTP request. The most common example of this is a message flow that invokes a Web service. For information on Web service applications, see Web service applications.

Handling errors

Because the node interacts directly with an external service using TCP/IP, it can experience the following types of error:

  1. Errors that are generated by TCP/IP, for example no route to host or connection refused.

    If the node detects these errors, it generates an exception, populates the exception list with the error information received, and routes the input message unchanged to the failure terminal.

  2. Errors that are returned by the Web server. These are HTTP status codes outside the range 100 through 299. If the node detects these errors, it routes the reply to the node’s error terminal whilst following the properties specified on the Error tab on the request node.

    The reply will be output as a BLOB, as the node cannot determine what format the reply will be. If you have not configured this node to handle redirection, messages with a redirection status code (3xx) are also handled in this way.

HTTP Response Codes

The HTTPRequest node treats the 100 series status codes as a continue response, discards the current response and waits for another response from the Web server.

The 200 series status codes are treated as success and the response is routed to the out terminal of the node, whilst following the settings on the various tabs on the node for the format of the output message generated.

The 300 series status codes are for redirection. If the Follow Redirection property is selected, the node does not resend the request to the new specified in the response received. If the Follow Redirection property is not selected, the codes is treated as an error as described in the section above on handling errors.

The 400 and 500 series status codes are errors, and are treated as described section above on handling errors.

Manipulating headers

If the Replace input message with web-service response property, or Replace input with error property is selected, the header for the input message, that is, the header that belongs to the message as it arrives at the IN terminal of the HTTPRequest node, is not e propagated with the message that leaves the HTTPRequest node. However, if one of the properties that specifies a location in the message tree is specified, the input message’s headers are propagated.

The HTTPResponse header, which contains the headers that are returned by the remote Web service, is the first header in the message that is propagated from the node, after properties. This is true regardless of the options that are chosen. Therefore, if you want the reply from the HTTPRequest node to be put to an MQ queue, you must manipulate the headers so that an MQMD is the first header (after properties).

If you are replacing the input message with a response, you can copy the input message's MQMD to the Environment tree before the HTTPRequest node, and then copy it back into the message tree after the HTTPRequest node. If you are specifying a location for the response, in order to maintain existing input message headers, you must move or remove the HTTP Response header so that the MQMD is the first header.

The following is an example containing ESQL that removes the HTTPHeader:
SET OutputRoot = InputRoot;
SET OutputRoot.HTTPResponseHeader = NULL; 
The following is an example containing ESQL for moving the HTTPHeader, and therefore preserving the information that it provides:
SET OutputRoot = InputRoot;
DECLARE HTTPHeaderRef REFERENCE TO OutputRoot.HTTPResponseHeader;
DETACH HTTPHeaderRef;
ATTACH HTTPHeaderRef TO OutputRoot.MQMD AS NEXTSIBLING;

Enabling HTTP GET

By default the HTTPRequest node uses the HTTP POST method when connecting to the remote Web server. To enable the request node to use the HTTP GET method instead, you must set a field in the output local environment tree, as shown in the following example:
SET OutputLocalEnvironment.Destination.HTTP.RequestLine.Method = 'GET';

Configuring the HTTPRequest node

When you have put an instance of the HTTPRequest node into a message flow, you can configure it. Right-click the node in the editor view and click Properties. The node's basic properties are displayed.

All mandatory properties for which you must enter a value (those that do not have a default value defined) are marked with an asterisk on the properties dialog.

Configure the HTTPRequest node as follows:

  1. The HTTPRequest node determines the URL for the Web service to which it sends a request. You must set one of the following three options; the node checks these in the order shown (that is, the first always overrides the second, the second overrides the third):
    1. X-Original-HTTP-URL in the HTTPRequest header in the input message
    2. LocalEnvironment.Destination.HTTP.RequestURL in the input message
    3. The Web Service URL property

    The first two options provide you with dynamic methods to set a URL for each input message as it passes through the message flow. If you want to use either of these options, you must include a Compute node in the message flow before the HTTPRequest node to create and initialize the required value.

    The third option provides a value that is fixed for every message received in this node. You must set this property to contain a default setting that is used if the other fields have not been created, or contain a null value. If either field contains a value, the setting of this property is ignored. The Web Service URL property must contain a valid URL or the deploy will fail. You must also ensure that the value that you set in X-Original-HTTP-URL or the LocalEnvironment.Destination.HTTP.RequestURL is also a valid URL; if it is not, the node generates an exception and the message is propagated to the failure terminal.

    If a URL begins http:// the request node makes an HTTP request to the specified URL. If the URL begins https:// the request node makes an HTTP over SSL (HTTPS) request to the specified URL, using the parameters that are specified in the SSL tab on the node.

  2. Set the Request timeout value. This is the length of time that the node waits for a response from the Web service. If a response is received within this time, the reply is propagated through the out terminal to the rest of the message flow. If a response is not received within this time, the input message is propagated through the failure terminal, if it is connected. If the failure terminal is not connected, and a response is not received in this time, an exception is generated.
  3. In HTTP(S) Proxy Location, set the location of the proxy server to which requests are sent.
  4. Select or clear the Follow HTTP(S) redirection check box to specify how the node handles Web service responses that contain an HTTP status code of 300 through 399:
    • If you select the check box, the node follows the redirection provided in the response and reissues the Web service request to the new URL included in the message content.
    • If you clear the check box, the node does not follow the redirection provided. The response message is propagated to the error terminal.
  5. Select the HTTP Version. The possible values for the HTTP Version property are 1.0 and 1.1.

    If you select HTTP/1.1, you have the option of also using HTTP/1.1 keep-alive.

  6. If you a planning on using HTTP over SSL (HTTPS) requests, select the SSL tab and set the values for https requests.
    • Specify the protocol that is to be used to make the request. The following options are available:
      • SSL (the default). This tries to connect using the SSLv3 protocol first, but allows the handshake fall back to the SSLv2 protocol where the SSLv2 protocol is supported by the underlying JSSE provider.
      • SSLv3. This tries to connect with the SSLv3 protocol only. Fall back to SSLv2 is not allowed.
      • TLS. This tries to connect with the TLS protocol only. Fall back to SSLv3 or SSLv2 is not allowed.

        Note that both ends of an SSL connection must agree on the protocol to use, so the chosen protocol must be one that the remote server can accept.

    • Specify the Allowed SSL Ciphers. This setting allows you to specify a single cipher (such as SSL_RSA_FIPS_WITH_3DES_EDE_CBC_SHA) or a list of ciphers that will be the only ones used by the connection. This set of ciphers must include one or more that are accepted by the remote server. A comma is used as a separator between the ciphers. The default (an empty string) allows the node to use any, or all or the available ciphers during the SSL connection handshake, which allows the greatest scope for making a successful SSL connection.
  7. Select Advanced in the properties dialog navigator and set values for the Advanced properties that describe the structure and content of the Web service request and response.
    1. Specify the content of the request message that is sent to the Web service:
      • If you want the request message to be the whole input message body, leave the Use whole input message as request check box selected (this is its default setting).

        If you want the request message to contain a subset of the input message, clear this check box and complete the property Request message location in tree.

      • In Request message location in tree, enter the start location from which the content of the input message tree is copied to the request message. This property is required only if you have cleared the Use whole input message as request property. The node creates a new request message and copies the specified parts of the input message (the input message itself is not modified).

        You can enter any valid ESQL field reference, including expressions within the reference. For example, enter:

        InputRoot.XMLNS.ABC

        If you select the Use whole input message as request check box, this property is ignored.

      When the appropriate message tree content is parsed to create a bit stream, the message properties (domain, set, type, and format) associated with the input message body and stored in the Properties folder are used.

    2. Specify the content of the output message that is propagated to the next node in the message flow:
      • If you want the whole Web service response message to be propagated as the output message, leave the Replace input message with web-service response check box selected (this is its default setting).

        If you want the Web service response message to be included in the output message with part of the input message content, clear this check box and complete the property Response message location in tree. If you clear this property, the node copies the input message to the output message and writes the Web service response message over the output message content at the specified location (the input message itself is not modified).

      • In Response message location in tree, enter the start location within the output message tree at which the parsed elements from the Web service response message bit stream are stored. This property is required only if you have cleared the Replace input message with web-service response property.

        You can enter any valid ESQL field reference, including expressions within the reference, and including new field references (to create a new node in the message tree for the response). For example, enter:

        OutputRoot.XMLNS.ABC.DEF
        or
        Environment.WSReply

        If you select the Replace input message with web-service response check box, this property is ignored.

      When the response bit stream is parsed to create message tree contents, the message properties (domain, set, type, and format) that you have specified in the node Default properties (described below) are used.

    3. If you want the node to generate an HTTPRequestHeader for the request message, leave the Generate default HTTP headers from input check box selected (this is the default setting).

      If you do not want the node to generate an HTTPRequestHeader for the request message, clear the Generate default HTTP headers from input check box (the default setting is selected). To control the contents of the HTTPRequestHeader that is included in the request message, include a Compute node that adds an HTTPRequestHeader to the input message before this HTTPRequest node in the message flow, and clear this check box.

      • If you have selected Generate default HTTP headers from input and the input message includes an HTTPRequestHeader, the node extracts Web service headers from the input HTTPRequestHeader and adds any unique Web service headers, except Host (see table below), that are present in an HTTPInputHeader, if one exists in the input message. (An HTTPInputHeader might be present if the input message has been received from a Web service by the HTTPInput node.)

        It also adds the Web service headers shown in the following table, with default values, if these are not present in the HTTPRequestHeader or the HTTPInputHeader.

        Header Default value
        SOAPAction "" (empty string)
        Content-Type text/xml; charset=utf-8
        Host The hostname to which the request is to be sent

        It also adds the optional header Content-Length with the correct calculated value, even if this is not present in the HTTPRequestHeader or the HTTPInputHeader.

      • If you have selected Generate default HTTP headers from input and the input message does not include an HTTPRequestHeader, the node extracts Web service headers, except Host, from the HTTPInputHeader, if it is present in the input message. It adds the required Web service headers with default values, if these are not present in the HTTPInputHeader.
      • If you have cleared Generate default HTTP headers from input and the input message includes an HTTPRequestHeader, the node extracts all Web service headers present in the input HTTPRequestHeader. It does not check for the presence of an HTTPInputHeader in the input message, and it does not add the required Web service headers if they are not supplied by the input HTTPRequestHeader.
      • If you have cleared Generate default HTTP headers from input and the input message does not include an HTTPRequestHeader, no Web service headers are generated. The node does not check for the presence of an HTTPInputHeader in the input message and does not add any required Web service header. The request message is propagated to the Web service without an HTTPRequestHeader. This typically causes an error to be generated by the Web service, unless the Web service is configured to handle the message contents.
  8. Select Error in the properties dialog navigator and set values for the properties that determine how an error message returned by the Web service is handled.
    • If you want the whole Web service error message to be propagated as the output message, leave the Replace input with Error check box selected (this is its default setting).

      If you want the Web service error message to be included in the output message with part of the input message content, clear this check box and complete the property Error message location. If you clear this property, the node copies the input message to the output message and writes the Web service error message over the output message content at the specified location (the input message itself is not modified).

    • In Error message location, enter the start location within the output message tree at which the parsed elements from the Web service error message bit stream are stored. This property is required only if you have cleared the Replace input with Error property.

      You can enter any valid ESQL field reference, including expressions within the reference and new field references (to create a new node in the message tree for the response). For example, enter:

      OutputRoot.XMLNS.ABC.DEF
      or
      Environment.WSError

      If you select the Replace input with Error check box, this property is ignored.

  9. Select Default in the properties dialog navigator and set values for the properties describing the message domain, message set, message type, and message format that the node uses to determine how to parse the response message returned by the Web service.

    If an error message is returned by the Web service, the values of these properties are ignored, and the message is parsed by the BLOB parser.

    • In Message Domain, select the name of the parser that you are using from the drop-down list. You can choose from the following names:
      • MRM
      • XML
      • XMLNS
      • XMLNSC
      • JMSMap
      • JMSStream
      • MIME
      • BLOB
      • IDOC
    • If you are using the MRM or IDOC parser, select the correct message set from the drop-down list in Message Set. This list is populated with available message sets when you select MRM or IDOC as the domain.

      Leave Message Set blank for XML, XMLNS, XMLNSC, JMS, MIME, and BLOB parsers.

    • If you are using the MRM parser, select the correct message from the drop-down list in Message Type. This list is populated with messages that are defined in the message set that you have selected.

      Leave Message Type blank for XML, XMLNS, XMLNSC, JMS, MIME, BLOB, and IDOC parsers.

    • If you are using the MRM or IDOC parser, select the format of the message from the drop-down list in Message Format. This list includes all the physical formats that you have defined for this message set.

      Leave Message Format blank for XML, XMLNS, XMLNSC, JMS, MIME, and BLOB parsers.

  10. Select Validation in the properties dialog navigator if you want the MRM parser to validate the body of messages against the dictionary generated from the message set. (If a message is propagated to the failure terminal of the node, it is not validated.)

    For more details refer to Validating messages and Validation properties for messages in the MRM domain.

  11. Select General Message Options in the properties dialog navigator. Parse Timing is, by default, set to On Demand. This causes validation to be delayed until it is parsed by partial parsing. If you change this to Immediate, partial parsing is overridden and everything in the message is parsed and validated, except those complex types with a Composition of Choice or Message that cannot be resolved at the time. If you change this to Complete, partial parsing is overridden and everything in the message is parsed and validated; complex types with a Composition of Choice or Message that cannot be resolved at the time cause a validation failure.
  12. Select Description in the properties dialog navigator to enter a short description, a long description, or both.
  13. Click Apply to make the changes to the HTTPRequest node without closing the properties dialog. Click OK to apply the changes and close the properties dialog.

    Click Cancel to close the dialog and discard all the changes that you have made to the properties.

Connecting the output terminals to another node

Connect the out, error, or failure terminal of this node to another node in this message flow to process the message further, process errors, or send the message to an additional destination. If you do not connect the error terminal, the message is discarded. If you do not connect the failure terminal, the broker provides default error processing, described in Handling errors in message flows.

Terminals and properties

The HTTPRequest node terminals are described in the following table.

Terminal Description
In The input terminal that accepts a message for processing by the node.
Failure The output terminal to which the message is routed if a failure is detected during processing in the node.
Out The output terminal to which the message is routed if it represents successful completion of the Web service request, and if further processing is required within this message flow.
Error The output terminal to which messages that include an HTTP status code that is not in the range 200 through 299, including redirection codes (3xx) if you have not set property Follow HTTP redirection.

The following tables describe the node properties; the column headed M indicates whether the property is mandatory (marked with an asterisk on the properties dialog if you must enter a value when no default is defined), the column headed C indicates whether the property is configurable (you can change the value when you add the message flow to the bar file to deploy it).

The HTTPRequest node Basic properties are described in the following table.

Property M C Default Description
Web Service URL Yes Yes   The URL for the Web service. You must provide this in the form http://<hostname>[:<port>]/[<path>] where
  • http://<hostname> must be specified
  • <port> defaults to 80. If you specify a value, you must include the : before the port number
  • <path> defaults to /. If you specify a value, you must include the / before the path.
Request Timeout Yes No 120 The time in seconds that the node waits for a response from the Web service. The valid range is 1 to (231)-1. You cannot enter a value that represents an unlimited wait.
HTTP(S) Proxy Location No Yes   The proxy server to which requests are sent. This must be in the form hostname:port.
Follow HTTP(S) redirection. No No Cleared Whether HTTP redirections are followed. If you select the check box, redirections are followed. If you clear this check box, redirections are not followed.
HTTP Version No Yes 1.0 The HTTP version to use for requests. Valid values are 1.0 and 1.1.
Enable HTTP/1.1 Keep-Alive No Yes Selected (if HTTP Version is 1.1) Use HTTP/1.1 Keep-Alive

The HTTPRequest node SSL properties are described in the following table.

Property M C Default Description
Protocol No Yes SSL The SSL protocol to use when making an HTTPS request.
Allowed SSL Ciphers No Yes   A comma-separated list of ciphers to use when making an SSL request. The default value of an empty string means use all available ciphers.

The HTTPRequest node Advanced properties are described in the following table.

Property M C Default Description
Use whole input message as request No No Selected Whether the whole input message body is to be passed to the Web service. If you select this check box, this action is performed. If you clear this check box, you must specify Request message location in tree.
Request message location in tree Yes No InputRoot The start location from which the bit stream is created for sending to the Web service. This property takes the form of an ESQL field reference.
Replace input message with web-service response No No Selected Whether the Web service response message replaces the copy of the input message as the content of the output message created. If you select this check box, this action is performed. If you clear this check box, you must specify Response message location in tree.
Response message location in tree Yes No OutputRoot The start location at which the parsed elements from the Web service response bit stream are stored. This property takes the form of an ESQL field reference.
Generate default HTTP headers from input No No Selected Whether an HTTPRequestHeader is generated. If you select this check box, this action is performed. If you clear this check box, a valid HTTPRequestHeader must exist in the input message.

The HTTPRequest node Error properties are described in the following table.

Property M C Default Description
Replace Input with Error No No Selected Whether the input message content is to be replaced by the error message content. If you select this check box, the action is performed. If you clear this check box, you must specify Error message location.
Error message location Yes No OutputRoot The start location at which the parsed elements from the Web service error bit stream are stored. This property takes the form of an ESQL field reference.

The HTTPRequest node Default properties are described in the following table.

Property M C Default Description
Message Domain No No   The domain that will be used to parse the response message that is received from the Web service.
Message Set No No   The name or identifier of the message set in which the response message is defined.
Message Type No No   The name of the response message.
Message Format No No   The name of the physical format of the response message.

The Validation properties of the HTTPRequest node are described in the following table.

Refer to Validation properties for messages in the MRM domain for a full description of these properties.

Property M C Default Description
Validate No Yes None Whether validation takes place. Valid values are None, Content and Value, Content, and Inherit.
Failure Action No No Exception What happens if validation fails. You can set this property only if you set Validate to Content or Content and Value. Valid values are User Trace, Local Error Log, Exception, and Exception List.
Include All Value Constraints No No Selected This property cannot be edited. The default action, which is indicated by the check box being selected, is that basic value constraint checks are included in Content and Value validation.
Fix No No None This property cannot be edited.

The properties of the General Message Options for the HTTPRequest node are described in the following table.

Property M C Default Description
Parse Timing No No On Demand This property controls when an input message is parsed. Valid values are On Demand, Immediate, and Complete.

Refer to Parsing on demand for a full description of this property.

Use MQRFH2C Compact Parser for MQRFH2 Domain No No Cleared This property controls whether the MQRFH2C Compact Parser, instead of the MQRFH2 parser, is used for MQRFH2 headers.

The properties of the XMLNSC Parser Options for the HTTPRequest node are described in the following table.

Property M C Default Description
Use XMLNSC Compact Parser for XMLNS Domain No No Cleared Start of changeThis property gives you control over whether the XMLNSC Compact Parser is used for messages in the XMLNS Domain. Note that if you set this property, the message data will appear under XMLNSC in nodes that are connected to the output terminal when the input RFH2 header or Default properties Domain is XMLNS.End of change
Mixed Content Retain Mode No No None This property controls whether the XMLNSC parser creates elements in the message tree when it encounters mixed text in an input message. Valid values are None and All. Selecting All means that elements are created for mixed text. Selecting None means that mixed text is ignored and no elements are created.
Comments Retain Mode No No None This property controls whether the XMLNSC parser creates elements in the message tree when it encounters comments in an input message. Valid values are None and All. Selecting All means that elements are created for comments. Selecting None means that comments are ignored and no elements are created.
Processing Instructions Retain Mode No No None This property controls whether the XMLNSC parser creates elements in the message tree when it encounters processing instructions in an input message. Valid values are None and All. Selecting All means that elements are created for processing instructions. Selecting None means that processing instructions are ignored and no elements are created.

The HTTPRequest node Description properties are described in the following table.

Property M C Default Description
Short Description No No   A brief description of the node.
Long Description No No   Text that describes the purpose of the node in the message flow.