CME Smart Stream on GCP SBE

CME Smart Stream on GCP SBE

This page contains information about CME MDP 3.0 SBE market data on CME Smart Stream on Google Cloud Platform (GCP). CME Smart Stream on GCP leverages Google Cloud Pub/Sub technology for market data distribution. For complete details regarding Google Cloud Pub/Sub please refer to Google Pub/Sub documentation.

Within CME Smart Stream, CME MDP refers to the CME Group Market Data Platform, which provides the complete array of CME Group market data. 

CME MDP 3.0 SBE is the CME Globex event-based bid, ask, trade and statistical market data format.

  • Real-Time - Real-time market data via CME Globex

  • Delayed (10 minute delay) - Allows customers to use CME Group data under delayed licensing terms. Traditionally, customers licensing delayed data had to self-manage the throttling of real-time feeds from exchanges per licensing policies. This cloud-based delivery mechanism provides customers with low cost, flexible and reliable access to data without the requirement to delay the content so they can focus on its use. Receipt of the data and licensing removes the requirement, complexity and cost of an intermediary service.

Contents

Market Data Offerings via Google Cloud 

CME Smart Stream on GCP includes MDP 3.0 channels (CME, CBOT, COMEX, NYMEX, GME), Streamlined SBE channels, Data Insights and BrokerTec U.S. Treasuries as follows:

  • Equity indices - S&P and Bloomberg

  • Settlements and Valuations

  • Block trades – GME

  • OTC daily

  • BrokerTec U.S. Treasury Market Data

The following table outlines all market data channels supported on CME Smart Stream on GCP.  

CME Group Channel ID

Channel Name

Market Data Platform Source

DCM/Venue/Market

CME Group Channel ID

Channel Name

Market Data Platform Source

DCM/Venue/Market

200 

CME Credit OTC

Streamlined - OTC Daily

CME

201 

CME Cleared OTC

Streamlined - OTC Daily

CME

210

S&P Indexes

Streamlined - Equity Indices

S&P

211

Dow Jones Indexes

Streamlined - Equity Indices

DJIA

213

CME CF Rates and Indexes

Streamlined - CME CF Cryptocurrency Indices

CME

215

BrokerTec US Treasury Data

BrokerTec US Treasury Data

BrokerTec/NEX Data

230

CME Block Trades

Streamlined - Block Trades

CME

231

CBOT Block Trades

Streamlined - Block Trades

CBOT

232

NYMEX Block Trades

Streamlined - Block Trades

NYMEX

233 

COMEX Block Trades

Streamlined - Block Trades

COMEX

234 

GME Block Trades

Streamlined - Block Trades

GME

251

CME Settlement and Valuations

Data Insights - Settlement and Valuations

CME

252

CBOT Settlement and Valuations

Data Insights - Settlement and Valuations

CBOT

253

NYMEX Settlement and Valuations

Data Insights - Settlement and Valuations

NYMEX

254

COMEX Settlement and Valuations

Data Insights - Settlement and Valuations

COMEX

261

CME Benchmark Administration Premium

Data Insights - CME Benchmark Administration Premium

CME

310

CME Globex Equity Futures

Globex MDP 3.0

CME

311

CME Globex Equity Options

Globex MDP 3.0

CME

312

CME Globex Interest Rate Futures

Globex MDP 3.0

CME

313

CME Globex Interest Rate Options

Globex MDP 3.0

CME

314

CME Globex FX Futures

Globex MDP 3.0

CME

315

CME Globex FX Options

Globex MDP 3.0

CME

316

CME Globex Commodity Futures

Globex MDP 3.0

CME

317

CME Globex Commodity Options

Globex MDP 3.0

CME

318

CME Globex Equity Futures - excludes E-mini S&P 500

Globex MDP 3.0

CME

319

CME Globex Equity Options - excludes E-mini S&P 500

Globex MDP 3.0

CME

320

CME Globex FX Futures II

Globex MDP 3.0

CME

321

CME Globex FX Options II

Globex MDP 3.0

CME

323

CME Globex Micro Equity Options

Globex MDP 3.0

CME

326

Cryptocurrency - Futures

Globex MDP 3.0

CME

327

Cryptocurrency - Options

Globex MDP 3.0

CME

329

Event Contracts

Globex MDP 3.0

CME

330

SpotFX+

Globex MDP 3.0

CME

340

CBOT Globex Commodity Futures

Globex MDP 3.0

CBOT

341

CBOT Globex Commodity Options

Globex MDP 3.0

CBOT

342

CBOT Globex Equity Index Futures

Globex MDP 3.0

CBOT

343

CBOT Globex Equity Index Options

Globex MDP 3.0

CBOT

344

CBOT Globex Interest Rate Futures

Globex MDP 3.0

CBOT

345

CBOT Globex Interest Rate Options

Globex MDP 3.0

CBOT

346

CBOT Globex Commodity Futures II

Globex MDP 3.0

CBOT

348

CBOT Globex Interest Rate Futures II

Globex MDP 3.0

CBOT

360

COMEX Globex Futures

Globex MDP 3.0

COMEX

361

COMEX Globex Options

Globex MDP 3.0

COMEX

380

NYMEX Globex Emissions Futures

Globex MDP 3.0

NYMEX

381

NYMEX Globex Emissions Options

Globex MDP 3.0

NYMEX

382

NYMEX Globex Crude & Crude Refined Futures

Globex MDP 3.0

NYMEX

383

NYMEX Globex Crude & Crude Refined Options

Globex MDP 3.0

NYMEX

384

NYMEX Globex Metals, Softs, & Alternative Market Futures

Globex MDP 3.0

NYMEX

385

NYMEX Globex Metals, Softs, & Alternative Market Options

Globex MDP 3.0

NYMEX

386

NYMEX Globex Nat Gas & other Non-Crude Energy Futures

Globex MDP 3.0

NYMEX

387

NYMEX Globex Nat Gas & other Non-Crude Energy Options

Globex MDP 3.0

NYMEX

430

BMD Globex Futures

Globex MDP 3.0

BMD

431

BMD Globex Options

Globex MDP 3.0

BMD

440

GME Globex Futures

Globex MDP 3.0

GME

441

GME Globex Options

Globex MDP 3.0

GME

 

Testing and Certification

The following section outlines testing and certification for GCP.

Certification

Certification via AutoCert+ is required for all client systems that will support CME Smart Stream on GCP. The following market data offerings have separate test suites:

  • Globex MDP 3.0

  • Data Insights - Settlement and Valuations

  • Streamlined - Block Trades

  • Streamlined - OTC Daily

  • Streamlined - CME CF Cryptocurrency Indices

  • Streamlined - Equity Indices

  • Streamlined - OTC Daily

  • BrokerTec U.S. Treasury Data

CME Globex Test Environments

The New Release test environment allows product and new functionality testing prior to release in production. Use the New Release environment to perform:

  • New product testing

  • Development testing on new functionality

  • Certification testing on new functionality


The New Release test environment has significantly lower data rates than production.

Getting Started with CME MDP Concepts

This section lists current CME MDP 3.0, Streamlined, Data Insight BrokerTec U.S. Treasury market data processing concepts applicable to CME MDP on Google Cloud Pub/Sub. If you are new to CME MDP technology or wish to better understand how your current system aligns with cloud-based technology, CME Group recommends starting here. 

Google Cloud Pub/Sub Market data recovery processing differs from the current MDP multicast offering and is outlined in this document.

MDP 3.0

Clients planning to process CME MDP CME Globex market data on Google Cloud Pub/Sub should be familiar with the following CME MDP 3.0 concepts:

Simple Binary Encoding (SBE)

Trade Summary

Book Processing

Statistics

Message Specification

Streamlined SBE

Clients planning to process Streamlined SBE on CME Smart Stream on GCP should be familiar with the following Streamlined SBE functional descriptions:

Equity Indices

OTC Daily

Block Trades

CME CF Cryptocurrency Indices

The message specifications for all streamlined systems are available here

Data Insights: Settlements and Valuations 

Clients planning to process CME Data Insights Settlements and Valuations market data should be familiar with the functional specification available here

BrokerTec U.S. Treasury Data

Clients planning to process BrokerTec U.S. Treasury market data on CME Smart Stream on GCP should be familiar with the functional specification available here.  

Market Data Support Services

Market data services provide the external data required to process CME Group market data.

Support Services

 There are two MDP services available for markets on CME Globex: Core Globex SBE Schema and CME Reference Data API. An FTP site is used to store the schema files for all environments.

Service

Description

Service

Description

Core Globex SBE Schema 

MDP is a template-based SBE protocol wherein a given message is interpreted by means of its corresponding template. Each message contains a unique Schema ID that references the template to use to interpret the message. The core CME Globex SBE schema is used across all market data groups.

CME Reference Data API 

Product and instrument referential data for CME Smart Stream on GCP can be obtained via CME Reference Data API.

  • MDP 3.0 tag 48-SecurityID maps to the Reference data API instrument field globexSecurityId.

  • Additionally, client systems can map Settlements and Valuations tag 7178-ProductGUID to CME Reference Data API fields and map Settlements and Valuations tag 37513-InstrumentGUID to CME Reference Data API GUID fields.

FTP Site Information

CME provides an FTP (ftp://ftp.cmegroup.com) and SFTP (sftpng.cmegroup.com) site to disseminate MDP SBE schemas and market data configuration information. This FTP/SFTP site contains the Schema and Configuration files for all events. 

Information applies as follows in the table:

  • Environment - specific environment (i.e., Certification, New Release, Production)

  • Service - Core Globex SBE Schema

  • FTP Site - address of the FTP/SFTP site

  • Directory Location - identifies directory

  • Client System Update Schedule - client systems should download updates according to schedule specified

Environment

Service

FTP/SFTP Site

Directory Location

Client System Update Schedule

Environment

Service

FTP/SFTP Site

Directory Location

Client System Update Schedule

New Release

Core Globex SBE Schema 

ftp.cmegroup.com or sftpng.cmegroup.com

/SBEFix/NRCert/Templates

Sunday prior to market open




How was your Client Systems Wiki Experience? Submit Feedback

Copyright © 2024 CME Group Inc. All rights reserved.