Email File ParserJune 23, 2022
Parser API Testing GUI
Our Parser API enables clients to easily convert thousands of emails per day into real-time actionable market data. Testing and/or debugging a single message has long been a bit of a chore. Over the last six months, we've made this testing and debugging task significantly easier through the introduction of our Parser Replay Viewer and No-Code Parser Interface. Today, we introduce an additional way to test parse single messages. We call it the Email File Parser. It allows our users to easily test parse messages one a time directly from their web browser.
This new feature can be found here: www.empirasign.com/email-file-parser/
- Enter API credentials.
- Select file to parse (email export to file instructions below).
- Select Parser API endpoint to target (mbs, corps, loans, or bwics).
- Click Submit Button
- View results
On the results page, you can click through to the associated Parser Replay page for even more data related to the parse transaction.
You will need API credentials to use this feature, but with our Freemium Pricing Tier you can get started without expense or obligation. Contact us today to receive your Parser API credentials.
How to Export Email Messages to a File
Outlook Client (.msg format)
- Double-click on the message you want to export.
- Select Save As on the File menu.
- Enter File name in the dialog box.
- Set Save as type to Outlook Message Format (this is the default setting).
- Click Save button.
Outlook Message Export Help
- Gmail / Google Workspace Client (.eml format)
- Select the message you want to export.
- Click on the three vertical dots icon at the top right of the message you are viewing.
- On the drop-down menu, select the Download message option.
- The message will be saved as an .eml file in your default Downloads directory.
Matching the WorldMay 23, 2022
We are pleased to announce a powerful new tool to help you drive increased trading activity. The All Matchers Report is akin to an auto targeter for your Fixed Income Salesforce. The reports can be accessed at the following URLs:
Report Generation Methodology
Collect the following lists of bonds:
- BWICs for a given day
- Runs and Offer Sheets for a given day
- N-PORT holdings reported in the last 90 days
- NAIC transactions in the last year
We then reduce the members of the above lists to only bonds appearing on two or more lists. Groups 1 and 2 are updated in real-time as we process BWICs and Runs throughout the day. For the May 17th report, 7,688 bonds fit these criteria.
For more information on our N-PORT flings and NAIC transactions data sets, please see the following blog posts:
Sample screenshot for the May 17th Report:
The report can be sorted and filtered on sector, sub-sector, and issuer via the controls on the table header. You can even filter all the way down to bonds that are simultaneously on a BWIC, Run, have recent holders, and recent NAIC transactions. To do this, click on the radio buttons above the report table. The screenshot below shows these 4-way matchers. We stipulate that these 4-way matchers are the most tradable bonds currently in the market. For May 17th, only 34 bonds are 4-way matchers.
Click to expand any line item to see linked BWICs, Runs, Mutual Funds, or Insurance Companies. Or click on the ISIN hyperlink to be directed to the
/secid/ page for the bond's full trading history. The bond shown below, EFF 2021-2 A2, appears on one BWIC, two dealer inventories, four N-PORT filings, and six NAIC transactions.
Programmatic access to the All Matchers Report is currently available (as of June 2022). The API Docs page has been updated with instructions for this query. You can also consult the all_matchers tab on the demo API spreadsheet if you're the type of person who likes to jump right into the pool. Our example Python code has also been updated. The bonds in this report can be retrieved by calling the
get_all_matchers function. The function definition can be found on github.
Example All Matchers API Use Case
- Poll /api/all-matchers/ endpoint.
- Send list of tradable bonds to your sales team.
- Rinse and repeat.
While you're busy crossing bonds, maybe it's time to give our Axes System another look. There's never been a better time to avail yourself of all the transaction and liquidity tools you can. Read more about our Axes System here: www.empirasign.com/blog/Empirasign-Axes/.
No-Code No Cost Parse and StoreMay 10, 2022
A few weeks back, we introduced our No-Code Parser Interface. Simply forward a Market Data email to one our dropboxes, and receive back parsed and normalized Market Data. Today, we greatly enhance this interface by linking it with our Parse and Store feature.
No-Code Parsing via our Email Gateway Interface (EGI)
Connect directly to our Parser API by simply forwarding a message to an Empirasign email address. Our Email Gateway Interface will handle the rest (validation, API authentication, data transport, response generation, etc.). We'll email you back when it's done. You can view the parser results by clicking on the enclosed link.
Where to send your runs
Example Parser Email Receipt
Parse and Store
Any time you search for a bond on Empirasign, you'll receive results from our public database as well as from the messages sent to one our of EGI dropboxes. By default, the data derived from these messages is viewable only to you. Colleagues at your organization can also be permissioned to view such data. An example bond search page is below. The top section is the standard public database results and the bottom section (circled in red) is the private User Data we have indexed for you.
Data collected via EGI can be managed on the MyData page (screenshot below). You can view emails and raw data, export raw and parsed data, and delete items. Data sharing within your organization can be permissioned here.
Superset the Market for Free
All web application clients have Parse and Store enabled for up to 100 messages per day at No Additional Cost. If you want to take a more programmatic approach to parsing large volumes of data, please reach out to us directly for an API Key.
EGI Parser Terms and Conditions
Only 100 messages per business day will be parsed and indexed for free via one of the above public dropboxes. If your message is rejected due to quota exhaustion, you can resubmit your message the next business day. Empirasign asserts no ownership over either the raw or finished materials sent to any of our EGI dropboxes.
No-Code Parser InterfaceApril 5, 2022
Send a runs email to one of our email dropboxes and receive back normalized and validated market quotes. With No-Code and No-Cost, there's never been an easier way to get started with our parser.
Parser as a Service Background
Empirasign first introduced our Parser as a Service in 2017 to provide clients with direct access to our market-leading, proprietary parsing technology via the simplicity of an API call. In the Extract, Transform, and Load process for message handling, the heavy lift is the Transform step. Our Parser as a Service enables clients to off-load this step to an outside vendor whose long-standing core competency is transforming unstructured data into structured form. Our Freemium Service Tier made it easier than ever to get started. However, technical hurdles remain.
Today we look to close the loop between developers and consumers.
No-Code Parsing via our Email Gateway Interface (EGI)
Today, anyone can take our parser for a spin by simply forwarding a message to an Empirasign email address. Our Email Gateway Interface will handle the rest (validation, API authentication, data transport, response generation, etc.). From your end it's as simple as forwarding an email and clicking on the link we send back.
Where to send your runs:
Example Response Email
After clicking the link, you'll be redirected to our parser GUI where you can review the message's parsed results. Export to CSV or JSON is available on this page as well. As we don't permanently store messages, the viewer page is only available for two weeks after a runs message is received by one of our dropboxes.
For more information on the GUI replay feature, please consult this blog post:
A few sample screenshots are below:
EGI Parser Terms and Conditions
Only a limited number of messages per business day will be parsed for free via one of the above public dropboxes. If your message is rejected due to free quota exhaustion, please resubmit your message the next business day. After two weeks, we delete all raw and processed data from our systems, and the viewer link will return a 404. Empirasign asserts no ownership over either the raw or finished materials sent to any of our parser email dropboxes.
If you want to get serious about parsing, contact us to be set up with an API Key for our Parser as a Service. Our Freemium Service Tier allows for 100 messages parsed per day (BWICs or Runs) at no cost to you.
Over the last few months we've been releasing more and more code examples and tutorials for both our Parser API and Market Data API. An overview of these efforts can be found on our developer resources page.
More to come
We have just begun to scratch the surface of new and existing services we can offer via our Email Gateway Interface. Stay tuned for more updates on how you can interface with sophisticated solutions in a No-Code manner.
INTEX Data ExportMarch 7, 2022
File System Access API
Using a new browser feature called the File System Access API, we are now able to bring you a previously unattainable level of integration between web-based applications and installed applications. Furthermore, this can all be done without the need to install any new bridge or middleware software. The first integration we are pleased to announce is direct export of Empirasign Market Data to INTEXcalc.
INTEXcalc will automatically consume third party market data if such data is in INTEX compatible format and stored in directories INTEXcalc is watching. The former part is relatively easy, but the latter part was impossible without installing extra software--until now, that is. Empirasign has created this automatic integration via leveraging your browser's built-in File System Access API.
- Create a folder called
market_dataunder Documents or on a shared drive. The latter method allows for easy data sharing with colleagues.
- Configure your copy of INTEXcalc to read from this directory.
- Go to the BWIC Monitor or Market Monitor tab on INTEXcalc.
- Click the gear icon and select Market Data Settings.
- Change Market Data Directory from Default Location to Custom Location.
- Choose the same
market_datafolder as selected above.
- Click the Refresh button on INTEXcalc to load any data exported from Empirasign.
- The above steps are only necessary upon initial configuration or if your
market_datadirectory location has changed. For security reasons, the File System Access API cannot directly access INTEXcalc's default market data directory location (usually under
Screenshot of INTEXcalc Market Data Directory Chooser Dialog
With that ceremony out of the way, you are now free to export data at will on any bwic or secid page by clicking on the INTEX icon. In the screenshot below of a sample BWIC, the INTEX export icon is circled in red.
Exported Empirasign Market Data is viewable on the following INTEXcalc screens:
- BWIC Monitor
- Single Deal Analysis
- Portfolio Analysis
- Market Monitor Report
Where Did the Files Go?
Our web application will create bwic data files that look
220215D.bwic) and market color files that look like
US31395D6Q71.mktd). An example directory tree is displayed below. All files live under the
market_data directory you selected above (blue folder in image). All bwic data files live under the
bwic\YYYYMMDD subdirectory. The folders in red (
market_color) are created by our web app (if they do not already exist). Our web app also creates the
YYYYMMDD directories (as needed).
How Did We Do This?
Below is a diagram showing how the Market Data flows from Empirasign's servers to the INTEXcalc application.
Even though the File System Access API is about web applications, we did not want to leave our API clients out in the cold. Below are two recently released two INTEX-specific scripts.
This script repeatedly polls the Empirasign API for BWIC information in selected sector(s). Data is exported to INTEXcalc market data folders in the INTEXcalc BWIC/JSON format.
This script leverages the
/api/bonds/ API endpoints to fill up the INTEX
market_data/market_color directory with fresh market data for client-specified sector(s).
Do check out our new Developer Resources page. This is the best place to start for anything technical or API related.