infernocommunity/client-fhir-testing repository overview

⁠client-fhir-testing

Tool to test a client's conformance with a FHIR implementation guide.

⁠Quick Run:

ruby start-proxy.rb

⁠Setup:

The client fhir testing tool is in the form of a proxy application that will record transactions between a fhir client and a fhir server. These HTTP transactions are recorded in a database where validation tests can later be run against them. The requests can also be replayed to mimic client or server endpoints.

For development purposes we will use the Inferno tool to act as a FHIR client and a public endpoint will be used as a FHIR server.

⁠Install & Run Inferno (Client)

1. Download & install inferno using Docker directions:
   https://github.com/onc-healthit/inferno#installation-and-deployment⁠

2. Make sure docker desktop app is running

3. Run

docker-compose up

1. open http://localhost:4567/⁠

⁠Run Proxy

1. Download this github repo

git clone https://github.com/inferno-community/client-fhir-testing.git
cd client-fhir-testing

1. Run proxy

The following will read options from filename. If filename does not exist, one with default options will be created for you. If filename is left unspecified, proxy.yml will be used by default.

It is important to set the backend config option as this is the destination the proxy forwards to.

ruby start-proxy.rb [filename]

Alternatively, you can start the proxy via the rackup process and specify the backend as an environment variable.

FHIR_PROXY_BACKEND="https://r4.smarthealthit.org" rackup config.ru -p 9292 -o 0.0.0.0

⁠Docker

Run the proxy and a test Inferno instance (and all of its requirements) using the Compose script:

docker-compose up --build

This will map in the proxy.yml from the client-fhir-testing folder. This way, you can update the proxy data without having to rebuild the image.

In this compose file, Inferno is accessible at http://localhost:4567, and the proxy is available at http://localhost:9292.

⁠Run Inferno tests

We use inferno as our client but you can use any client/server interactions in this step. Note that the docker URL listed below resolves to the docker host machine on which the proxy is running. Using localhost would refer to the docker instance and not the host itself.

1. On the Inferno homepage, under "Start Testing", select "US Core v3.1.0", and put in the address of the proxy service http://host.docker.internal:9292

2. Run tests, check the database for logged HTTP transactions.

⁠Run Validator in command line

The validator is developed based on the US Core Client CapabilityStatement⁠. The client CapabilityStatement JSON file⁠ was parsed into three tables, interaction⁠, searchParam⁠, and search_criteria⁠. Capabilities rules from the three tables were used to validate the client requests.

We created a collection of Postman requests⁠ to simulate a client test. The tool newman⁠ can be used to send the collection of requests to the proxy server.

1. To start the proxy server locally with the port 9292.

ruby start-proxy.rb

1. To send the requests with newman⁠ under the test directory.

cd test
newman run fhir-client-test.postman_collection.json

1. To run validator for the collection of requests.

ruby ../test-validator.rb

A checklist.csv report will be generated and also a check_list table created in the database. Here are the description of the report.