• Home
  • Politics
  • News
  • Business
  • Health
  • Entertainment
  • Sports
  • Lifestyle
  • Education
  • Opinion
Saturday, 28 May, 2022
  • Login
topfmonline.com
 
  • Home
  • News
  • Politics
  • Business
  • Entertainment
  • Health
  • Lifestyle
  • Sports
  • Education
  • Technology
  • Foreign
No Result
View All Result
topfmonline.com
No Result
View All Result
Home Technology

Google Cloud launches BigLake, a new cross-platform data storage engine

TOPFM NEWS by TOPFM NEWS
April 6, 2022
in Technology
A A
0
Google Cloud launches BigLake, a new cross-platform data storage engine
0
SHARES
2
VIEWS
Share on FacebookShare on Twitter

At its Cloud Data Summit, Google today announced the preview launch of BigLake, a new data lake storage engine that makes it easier for enterprises to analyze the data in their data warehouses and data lakes.

The idea here, at its core, is to take Google’s experience with running and managing its BigQuery data warehouse and extend it to data lakes on Google Cloud Storage, combining the best of data lakes and warehouses into a single service that abstracts away the underlying storage formats and systems.

This data, it’s worth noting, could sit in BigQuery or live on AWS S3 and Azure Data Lake Storage Gen2, too. Through BigLake, developers will get access to one uniform storage engine and the ability to query the underlying data stores through a single system without the need to move or duplicate data.

“Managing data across disparate lakes and warehouses creates silos and increases risk and cost, especially when data needs to be moved,” explains Gerrit Kazmaier, VP and GM of Databases, Data Analytics and Business Intelligence at Google Cloud, notes in today’s announcement. “BigLake allows companies to unify their data warehouses and lakes to analyze data without worrying about the underlying storage format or system, which eliminates the need to duplicate or move data from a source and reduces cost and inefficiencies.”

Using policy tags, BigLake allows admins to configure their security policies at the table, row and column level. This includes data stored in Google Cloud Storage, as well as the two supported third-party systems, where BigQuery Omni, Google’s multi-cloud analytics service, enables these security controls. Those security controls then also ensure that only the right data flows into tools like Spark, Presto, Trino and TensorFlow. The service also integrates with Google’s Dataplex tool to provide additional data management capabilities.

Google notes that BigLake will provide fine-grained access controls and that its API will span Google Cloud, as well as file formats like the open column-oriented Apache Parquet and open-source processing engines like Apache Spark.

“The volume of valuable data that organizations have to manage and analyze is growing at an incredible rate,” Google Cloud software engineer Justin Levandoski and product manager Gaurav Saxena explain in today’s announcement. “This data is increasingly distributed across many locations, including data warehouses, data lakes, and NoSQL stores. As an organization’s data gets more complex and proliferates across disparate data environments, silos emerge, creating increased risk and cost, especially when that data needs to be moved. Our customers have made it clear; they need help.”

In addition to BigLake, Google also today announced that Spanner, its globally distributed SQL database, will soon get a new feature called “change streams.” With these, users can easily track any changes to a database in real time, be those inserts, updates or deletes. “This ensures customers always have access to the freshest data as they can easily replicate changes from Spanner to BigQuery for real-time analytics, trigger downstream application behavior using Pub/Sub, or store changes in Google Cloud Storage (GCS) for compliance,” explains Kazmaier.

Related Posts

AMD unveils Epyc confidential computing on Google cloud

AMD unveils Epyc confidential computing on Google cloud

May 27, 2022
1
Microsoft announces Project Volterra ARM based mini PC

Microsoft announces Project Volterra ARM based mini PC

May 27, 2022
0
Source: TechCrunch
Via: Frederic Lardinois
Tags: Google Cloud launches BigLake
Previous Post

Intel becomes latest Western tech firm to suspend business in Russia

Next Post

Apple has yet to fix zero-day exploits for macOS Big Sur and Catalina users

Related Posts

AMD unveils Epyc confidential computing on Google cloud
Technology

AMD unveils Epyc confidential computing on Google cloud

May 27, 2022
1
Microsoft announces Project Volterra ARM based mini PC
Technology

Microsoft announces Project Volterra ARM based mini PC

May 27, 2022
0
Broadcom announces plans to buy VMware in $61 billion deal
Technology

Broadcom announces plans to buy VMware in $61 billion deal

May 27, 2022
1
iOS 16 concept will have you wishing it was September already
Technology

iOS 16 concept will have you wishing it was September already

May 26, 2022
1
Elon Musk will put up $6 billion to drop Tesla loans from his Twitter deal
Technology

Elon Musk will put up $6 billion to drop Tesla loans from his Twitter deal

May 26, 2022
0
AMD Expands Confidential Computing Presence on Google Cloud
Technology

AMD Expands Confidential Computing Presence on Google Cloud

May 26, 2022
1
Next Post
Apple has yet to fix zero-day exploits for macOS Big Sur and Catalina users

Apple has yet to fix zero-day exploits for macOS Big Sur and Catalina users

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

BROWSE BY CATEGORIES

  • Business
  • Education
  • Entertainment
  • Foreign
  • Health
  • Lifestyle
  • News
  • Opinion
  • Politics
  • Sports
  • Technology
  • Uncategorized

BROWSE BY TOPICS

5G 2022 Budget AFCON Afghanistan akufo addo Amazon Apiate explosion Appiate apple AT&T Biden Black Stars covid COVID-19 COVID 19 E-Levy facebook Ghana Police Service Google Hackers health Intel iphone meta Microsoft NLC Nvidia OMICRON Parliament police Russia Samsung security South Africa Taliban tech Tesla Trump twitter US UTAG vaccine WHO Windows 11 Xinjiang

Recent Posts

  • AMD unveils Epyc confidential computing on Google cloud
  • Microsoft announces Project Volterra ARM based mini PC
  • Broadcom announces plans to buy VMware in $61 billion deal
  • Russia slams sanctions, seeks to blame West for food crisis
  • Germany’s Scholz says Russia will not win the war in Ukraine

Recent Comments

No comments to show.

RECENT NEWS

  • AMD unveils Epyc confidential computing on Google cloud May 27, 2022
  • Microsoft announces Project Volterra ARM based mini PC May 27, 2022
  • Broadcom announces plans to buy VMware in $61 billion deal May 27, 2022
  • Russia slams sanctions, seeks to blame West for food crisis May 27, 2022

MAIN CATEGORIES

  • Business
  • Education
  • Entertainment
  • Foreign
  • Health
  • Lifestyle
  • News
  • Opinion
  • Politics
  • Sports
  • Technology
  • Uncategorized

Entertainment

TOP FM enters Mallam Atta market with “Apomuden” Festival
Business

TOP FM enters Mallam Atta market with “Apomuden” Festival

2 months ago
5
  • ABOUT US
  • CONTACT
  • ADVERTISE

© 2021 Top Media Group - Powered by BackUp Data Systems

No Result
View All Result
  • Home
  • Politics
  • News
  • Business
  • Health
  • Entertainment
  • Sports
  • Lifestyle
  • Education
  • Opinion

© 2021 Top Media Group - Powered by BackUp Data Systems

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
LIVE UPDATES ON COVID-19 CASES
  • Ghana
    Confirmed Cases 161,370
    Active Cases 44
    Recovered Cases 159,881
    Death Cases 1,445