CME DataMine Dataset Delivery Migration

Effective Wednesday, November 6, 2024, CME Group is directing all Benchmark Dataset CME DataMine customers to switch their delivery mechanisms to a new platform. Clients receiving the data from the File Browser/UI, API, SFTP, and S3 will be required to make updates to continue receiving their data. Clients will have until Monday, March 31, 2025, to make this change or their data access will be cut off. 

Benchmark data Includes the following products: 

  • CME Group Volatility Index (CVOL) End of Day

  • CME Group Volatility Index (CVOL) Intra Day

  • CME Term SOFR 

  • CME Term SOFR Constituent Files 

  • CME Term SOFR Daily Returns

  • CME Group Petroleum Index Value

  • CME Group Petroleum Intraday Index 

  • Livestock Price Indices 

  • Repo Funds Rate (RFR) - Euro

  • Repo Funds Rate (RFR) - JBOND

  • Repo Funds Rate (RFR) - Sterling

Contents

Revision History

Date

Description

Date

Description

November 4, 2024

Initial publication of this pending client impact topic.

Key Events and Dates

Date

Milestone

Date

Milestone

November 6, 2024

Availability to switch CME DataMine dataset delivery mechanism to new platform.

March 31, 2025

Cut off for switching CME DataMine dataset delivery mechanism.

Client System Impacts

File Download REST API

Clients may continue to download files over the CME DataMine REST API using existing CME DataMine Basic Auth API ID. The criteria and file id information will all remain the same, along with the data contents. The only change to the file download API will be the URL and Endpoints changing to the following:

Endpoint

Examples

Authentication is required to access example data.

File Download API Criteria

Name

Description

Required

Type

Name

Description

Required

Type

fid

File IDs are available from the Order History page under My Account.

The fid format is: yyyymmdd-dataset_exch_symbol_foi_spread-venue, these fid values will remain the same.

foi possible value:

  • fut

  • opt

spread possible value:

  • 0 for outright

  • 1 for spread

Example: 20240107-bbo_xcme_sp_fut_0-rth

Yes

String

A list of File IDs (fid) is now available. 

S3 Transfer

S3 will continue to be a supported delivery destination and requires slight authorization modifications to continue using this service.

  1. From the new DateMine, navigate to Settings > Data Delivery Destinations > Add Delivery Destination to set up a new delivery location.

  2. Input the bucket name, optional subfolder name, and optional nickname for the destination.

  3. Once saved, paste the below policy into the S3 Bucket Policy section of the AWS account to start receiving files.
    Test the configuration by selecting Test Connection to ensure the details are input correctly. Please update the {bucketName} and/or update "*" or {subPath} to reflect the target AWS bucket.

    S3 Policy

    { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowForeignS3Access", "Effect": "Allow", "Principal": { "AWS": [ "arn:aws:iam::905418243502:role/venus-cmeprod-airflow-ecs-AirflowTaskRoleWithUserSe-VzZmh3EcAysc", "arn:aws:iam::905418243502:role/dhx-managed-s3-access-role-cmeprod" ] }, "Action": [ "s3:ListBucket", "s3:GetBucketLocation", "s3:PutObject" ], "Resource": [ "arn:aws:s3:::{bucket_name}/*", "arn:aws:s3:::{bucket_name}" ] } ] }

     





  4.  Paste and save the above statement into your bucket policy and save the changes. Set up to transfer data is enabled.

SFTP

SFTP details will be included when available.

File Download Interface

  1. Navigate to My Account > My Data.

  2. Under the Access Data column select Download.

Email File Sharing

A newly supported delivery offering is available to receive files pushed via email. To select, navigate to Settings > Data Delivery Destinations.

Contact Information

For assistance, see CME DataMine Support Contacts.




How was your Client Systems Wiki Experience? Submit Feedback

Copyright © 2024 CME Group Inc. All rights reserved.