Request a Call Back

What are the infrastructure requirements for deploying Feast in a multi-cloud environment?


Our organization uses AWS for storage but GCP for our heavy-duty ML training. Can Feast manage an offline store in BigQuery while serving online features from a Redis instance on AWS? We need to understand the cost and latency implications of this cross-cloud setup for our data pipeline.


   2025-05-22 in Cloud Technology by Vanessa Jenkins | 11845 Views


All answers to this question.


Managing Feast across different clouds is technically possible because it is a "pluggable" framework. You can definitely point your feature_store.yaml to BigQuery for your offline historical data and a Redis cluster on AWS for your online serving. However, you need to be mindful of egress costs when materializing data from BigQuery to an external Redis instance. We found that the latency for fetching online features remains low (sub-10ms) as long as your inference service is in the same region as your Redis store. The "materialization" job—the process that moves data from offline to online—is what will take the hit on cross-cloud bandwidth, so schedule those jobs during off-peak hours.

   Answered 2025-05-24 by Danielle O'Connor


Have you considered using a unified data lake like Snowflake as your offline store to simplify the permissioning across your AWS and GCP accounts?

   Answered 2025-05-25 by Bradley Vance

  • We did look into Snowflake, Bradley, but our data is already deeply nested in BigQuery. We decided to stick with a "best of breed" approach. To handle permissions, we’re using Workload Identity Federation, which allows our AWS-based Feast workers to securely authenticate with GCP without managing long-lived service account keys. It’s a bit more setup initially, but it makes the multi-cloud architecture much more secure and compliant with our internal SOC 2 requirements for data handling across environments.

       Commented 2025-05-26 by Sean Maxwell


Feast's provider-agnostic design is its biggest strength for enterprises that don't want to be locked into a single cloud vendor's ecosystem

   Answered 2025-05-27 by Gregory Hudson

  • I agree with Gregory. Being able to swap out storage backends without rewriting our feature logic has been a lifesaver during our recent cloud migration

       Commented 2025-05-28 by Vanessa Jenkins



Write a Comment

Your email address will not be published. Required fields are marked (*)




Suggested Questions

Introduction to Project Management..
Posted 2026-07-07 by learnersera.
Balancing Link Metrics With Structural Entity Maps..
Posted 2025-05-12 by learnersera.
Balancing Link Metrics With Structural Entity Maps..
Posted 2025-05-12 by learnersera.
Impact of Entity Authority on Organic Competitive..
Posted 2025-01-04 by learnersera.
Backlinks vs Entity Authority for SEO Rankings..
Posted 2025-04-14 by learnersera.
How are modern agile organizations evaluating scrum..
Posted 2025-07-19 by learnersera.
Is a specialized technical degree required to..
Posted 2025-10-05 by learnersera.
How heavily do hiring managers weigh professional..
Posted 2025-09-12 by learnersera.

Disclaimer

  • "PMI®", "PMBOK®", "PMP®", "CAPM®" and "PMI-ACP®" are registered marks of the Project Management Institute, Inc.
  • "CSM", "CST" are Registered Trade Marks of The Scrum Alliance, USA.
  • COBIT® is a trademark of ISACA® registered in the United States and other countries.
  • CBAP® and IIBA® are registered trademarks of International Institute of Business Analysis™.

We Accept

We Accept

Follow Us

 facebook icon
 twitter
linkedin

Instagram
twitter
Youtube

Quick Enquiry Form

WhatsApp Us  /      +1 (713)-287-1187