Tech Support EX

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Wednesday, 18 September 2013

Stream your data into BigQuery in real-time

Posted on 08:00 by Unknown
Posted by Ju-kay Kwek, BigQuery Product Manager

Today, we live in a world where businesses are generating large amounts of real-time data from web applications that serve millions of users, online sales transactions, or customer activity created by an explosion of connected devices. Being able to react quickly to changes in the data being generated is critical to remain competitive. At the same time, businesses are gathering, storing and analyzing data -- sometimes 100s of gigabytes per day -- using legacy systems that struggle to keep up.

We built Google BigQuery to enable businesses to tackle this problem without having to invest in costly and complex infrastructure. And today this gets even easier with two key new features:

  • Real-time data streaming: you can now stream events row-by-row into BigQuery via a simple new API call. This enables you to store data as it comes in, rather than building and maintaining systems just to cache and upload in batches. The best part? The new data is available for querying instantaneously. Streaming ingestion is free for an introductory period until January 1st, 2014. After that it will be billed at a flat rate of 1 cent per 10,000 rows inserted. The existing batch-based ingestion will continue to be free.
  • Query portions of a table: you can now query a specific subset of a table using a simple new @<t> that we call a “table decorator” in your SQL statements. Though restricted to data inserted within the last 24 hours, this capability provides significant benefits beyond just cost efficiency -- for example, in conjunction with real-time data streaming, you can now use table decorators to monitor the last 30 minutes of user activity after a new change is pushed to your application.


In addition to these features, we’ve also expanded BigQuery’s window functions to include SUM and COUNT -- statistical capabilities that many customers have asked for -- as well as regular analytic functions for calculating Correlation and Standard Deviation.

And to make the entire querying experience smoother, the BigQuery user interface has also received numerous productivity-enhancing updates. These include an expanding information panel when clicking on a query, as well as action buttons at the bottom of the query box to make it easier to edit, run, save, and show results.

You can get details about these new capabilities and examples from our Developer Blog and in our updated product documentation.

Whether it’s for capturing streams of application event logging or real-time user behavior analysis, we can’t wait to hear how you’re using BigQuery’s new features. And we hope you’ll share with our community via the #BigQuery tag on Google+.
Email ThisBlogThis!Share to XShare to Facebook
Posted in Big Query | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • Mapping a clear strategy for business growth with Google
    Posted by A.V. Dharmakrishnan, Chief Executive Officer, Madras Cements Editor's note: Today’s guest is A.V. Dharmakrishnan, Chief Exec...
  • Keeping you safe in 2013
    Posted by Eran Feigenbaum, Director of Security, Google Enterprise Most businesses these days rely on technology to get their work done. An...
  • Hangout On Air: Lessons from a retail CIO on moving to the cloud with ease
    Posted by Meghdutt Brahmachari, Product Marketing Manager, Google Enterprise Change is never easy, but when a business has tens of thousand...
  • The Gateway to the West is moving into the cloud
    Posted by Francis G. Slay, Mayor of St. Louis, Missouri Editors note: Today, we welcome Mayor Francis G. Slay of the City of St. Louis , t...
  • Smart school: Cartoon program uses Google Apps
    Editors note: Today’s guest blogger is Michele Ollie, co-founder and President of The Center for Cartoon Studies , based in White River Jun...
  • Sperry Van Ness goes Google
    Posted by Kevin Maggiacomo, CEO of Sperry Van Ness Editors note: Today’s guest blogger is Kevin Maggiacomo, CEO of Sperry Van Ness, one of ...
  • Perry Ellis International brings their global team together with Google Apps
    Posted by Ronen Lapidot, Senior Vice President of Information Technology, Perry Ellis International Editors note: Today’s guest blogger is ...
  • Google Chromebooks provide personalization, collaboration for mSchool
    Posted by Elliot Sanchez, Founder and Chief Executive Officer, mSchool Editor's note: Today’s guest blogger is Elliot Sanchez, founder...
  • Colorado is the newest state to go Google
    Posted by Scott McIntyre, Director of State and Local Government, Google What does the State of Colorado have in common with neighboring sta...
  • Google Apps Improves Efficiency for Redfin Agents and Engineers
    Editor's note: Today's guest blogger is Eric Hollenbeck, Sr. Manager of IT & Business Services at Redfin , a technology-powered...

Categories

  • #gone google
  • #gonegoogle
  • #Google Apps
  • #innovationupgrade
  • #moregoogleapps
  • #SysAdminDay
  • #tbt
  • #throwbackthursday
  • #top10trust
  • 100% web
  • admin
  • admin sdk
  • Android
  • Apps
  • Apps Adventures
  • Asia Pacific
  • Audi
  • Audi Connect
  • Australia
  • big data
  • Big Query
  • bigquery
  • Boston
  • browser
  • Chrome
  • Chrome for Business
  • Chrome Frame
  • Chrome OS
  • chromebooks
  • Chromebooks for Education
  • chromebox
  • City 24/7
  • Clearing Kosovo
  • Cloud
  • cloud computing
  • cloud computing gonegoogle
  • cloud computing gonegoogle Google Apps
  • cloud computing gonegoogle Google Apps google docs small business success story
  • cloud computing gonegoogle Google Apps google docs small business success story switch
  • cloud datastore
  • cloud platform
  • cloud print
  • cloud services
  • cloud sql
  • collaboration
  • Colorado
  • contacts
  • customer love
  • Customer story
  • Customer testimonial
  • Developer
  • developers
  • Docs
  • documents
  • drive storage
  • Earth
  • earth and maps
  • education
  • enterprise
  • events
  • FedEx
  • Fedex.com
  • franchises
  • Gartner
  • GE
  • Global Partner Summit
  • gmail
  • Gone Google
  • gonegoogle
  • Google App Engine
  • Google Apps
  • Google Apps Blog
  • Google Apps Engine
  • Google Apps for Business
  • google apps for education
  • Google Apps for Government
  • Google Apps Reseller
  • Google Apps Script
  • Google Apps Vault
  • Google Calendar
  • Google Cloud Platform
  • google cloud storage
  • google commerce search
  • Google Compute Engine
  • google docs
  • google drive
  • Google Earth
  • Google Earth Enterprise
  • Google Earth Pro
  • Google Enterprise
  • Google Enterprise Search
  • Google Forms
  • Google Green
  • google groups
  • Google Maps
  • Google Maps API
  • Google Maps Coordinate
  • Google Maps Engine
  • Google Maps Engine public data program
  • Google Maps for Business
  • Google Maps Tracks API
  • Google Places API
  • google play for education
  • Google Prediction API
  • Google Search Appliance
  • google sites
  • Google spreadsheets
  • google storage
  • Google Storage for Developers
  • google+
  • Google+ api
  • Google+ Communities
  • googlenew
  • government
  • GSA
  • GSA 7.0
  • guest post
  • HALO Trust
  • Hangout on Air
  • hangouts
  • innovation
  • international trade
  • Internet Explorer
  • intranet
  • iOS
  • iPad
  • IT
  • K-12
  • large business
  • manufacturing
  • Maps
  • marketplace
  • medium business
  • mobile
  • moms
  • Mother's Day
  • NAVMAN
  • new features
  • Niagara International Transportation Technology Coalition
  • non-profit
  • noteworthy
  • offline
  • partner
  • partners
  • Place Summaries
  • Postini
  • productivity
  • Quickoffice
  • Receptionist's Day
  • retail
  • SBW2013
  • Search
  • Security
  • Sheets
  • Slides
  • small business
  • SMB
  • success story
  • support
  • System Admin
  • T Dispatch
  • Transport and Logistics
  • Trust
  • university
  • utilities
  • Veteran Owned Businesses
  • Veterans Day
  • wallet
  • webinar

Blog Archive

  • ▼  2013 (239)
    • ►  December (18)
    • ►  November (25)
    • ►  October (29)
    • ▼  September (19)
      • Amtrak maps trains from coast to coast with Google...
      • SeaPort Airlines takes off with Google Apps
      • Mexico’s Secretaría de la Función Pública brings g...
      • Hangout On Air: Tapping Into Big Data to Discover ...
      • More On Gmail’s Delivery Delays
      • Freeing Quickoffice for Everyone
      • Property management, powered by Chromeboxes
      • CAN Telematics and Google Maps enhance compliance ...
      • Stream your data into BigQuery in real-time
      • Hangout On Air: Speedway Motors Builds a Better St...
      • The HALO Trust: Helping communities reclaim the la...
      • Brazil’s telecom provider, TIM, improves customer ...
      • A fresh mix of Intel-based Chromebooks — something...
      • Back to School in Canada with Chromebooks and Goog...
      • New Hangout On Air Series: How Retailers Innovate ...
      • Four new ways to customize your Google Forms
      • Leon Speakers cranks up the productivity volume wi...
      • Toyota Motor Europe: Visualizing the road ahead wi...
      • LOSTnFOUND uses Google Maps to help reunite people...
    • ►  August (11)
    • ►  July (21)
    • ►  June (26)
    • ►  May (24)
    • ►  April (20)
    • ►  March (13)
    • ►  February (17)
    • ►  January (16)
  • ►  2012 (176)
    • ►  December (18)
    • ►  November (17)
    • ►  October (21)
    • ►  September (15)
    • ►  August (13)
    • ►  July (11)
    • ►  June (19)
    • ►  May (16)
    • ►  April (13)
    • ►  March (9)
    • ►  February (12)
    • ►  January (12)
  • ►  2011 (85)
    • ►  December (14)
    • ►  November (19)
    • ►  October (17)
    • ►  September (21)
    • ►  August (14)
Powered by Blogger.

About Me

Unknown
View my complete profile