Tech Support EX

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Wednesday, 18 September 2013

Stream your data into BigQuery in real-time

Posted on 08:00 by Unknown
Posted by Ju-kay Kwek, BigQuery Product Manager

Today, we live in a world where businesses are generating large amounts of real-time data from web applications that serve millions of users, online sales transactions, or customer activity created by an explosion of connected devices. Being able to react quickly to changes in the data being generated is critical to remain competitive. At the same time, businesses are gathering, storing and analyzing data -- sometimes 100s of gigabytes per day -- using legacy systems that struggle to keep up.

We built Google BigQuery to enable businesses to tackle this problem without having to invest in costly and complex infrastructure. And today this gets even easier with two key new features:

  • Real-time data streaming: you can now stream events row-by-row into BigQuery via a simple new API call. This enables you to store data as it comes in, rather than building and maintaining systems just to cache and upload in batches. The best part? The new data is available for querying instantaneously. Streaming ingestion is free for an introductory period until January 1st, 2014. After that it will be billed at a flat rate of 1 cent per 10,000 rows inserted. The existing batch-based ingestion will continue to be free.
  • Query portions of a table: you can now query a specific subset of a table using a simple new @<t> that we call a “table decorator” in your SQL statements. Though restricted to data inserted within the last 24 hours, this capability provides significant benefits beyond just cost efficiency -- for example, in conjunction with real-time data streaming, you can now use table decorators to monitor the last 30 minutes of user activity after a new change is pushed to your application.


In addition to these features, we’ve also expanded BigQuery’s window functions to include SUM and COUNT -- statistical capabilities that many customers have asked for -- as well as regular analytic functions for calculating Correlation and Standard Deviation.

And to make the entire querying experience smoother, the BigQuery user interface has also received numerous productivity-enhancing updates. These include an expanding information panel when clicking on a query, as well as action buttons at the bottom of the query box to make it easier to edit, run, save, and show results.

You can get details about these new capabilities and examples from our Developer Blog and in our updated product documentation.

Whether it’s for capturing streams of application event logging or real-time user behavior analysis, we can’t wait to hear how you’re using BigQuery’s new features. And we hope you’ll share with our community via the #BigQuery tag on Google+.
Email ThisBlogThis!Share to XShare to Facebook
Posted in Big Query | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • Mapping a clear strategy for business growth with Google
    Posted by A.V. Dharmakrishnan, Chief Executive Officer, Madras Cements Editor's note: Today’s guest is A.V. Dharmakrishnan, Chief Exec...
  • Keeping you safe in 2013
    Posted by Eran Feigenbaum, Director of Security, Google Enterprise Most businesses these days rely on technology to get their work done. An...
  • Google Apps for Education helps Pt England School raise achievement levels
    Posted by Dorothy Burt, professional development leader at Pt England School Editors note: Today’s guest blogger is Dorothy Burt, a profess...
  • Playworks Transforms more than Recess with Chromebooks and Apps
    Posted by Richard Ng, IT director, Playworks Editors note: Today’s guest blogger is Richard Ng, IT director at Playworks, a nonprofit organ...
  • FedEx.com re-imagined with Google Maps Engine
    Posted by Pat Doyle, Manager IT, FedEx Editor's note: Today we announced the availability of the Google Maps Engine API , letting organ...
  • GeoEye Using Google Earth Builder for Commercial Distribution of their Data
    Posted by Dylan Lorimer, Google Earth and Maps for Business Product Manager Since 2008, Google has worked with GeoEye to publish millions ...
  • Hangout On Air: Lessons from a retail CIO on moving to the cloud with ease
    Posted by Meghdutt Brahmachari, Product Marketing Manager, Google Enterprise Change is never easy, but when a business has tens of thousand...
  • Trying something new: Rent a Chromebook for $30 per month
    Posted by Divya Agarwalla, Product Manager, Chrome for Business Since launch, our vision for Chromebooks has been to bring the simplicity, f...
  • Google Chromebooks provide personalization, collaboration for mSchool
    Posted by Elliot Sanchez, Founder and Chief Executive Officer, mSchool Editor's note: Today’s guest blogger is Elliot Sanchez, founder...
  • Colorado is the newest state to go Google
    Posted by Scott McIntyre, Director of State and Local Government, Google What does the State of Colorado have in common with neighboring sta...

Categories

  • #gone google
  • #gonegoogle
  • #Google Apps
  • #innovationupgrade
  • #moregoogleapps
  • #SysAdminDay
  • #tbt
  • #throwbackthursday
  • #top10trust
  • 100% web
  • admin
  • admin sdk
  • Android
  • Apps
  • Apps Adventures
  • Asia Pacific
  • Audi
  • Audi Connect
  • Australia
  • big data
  • Big Query
  • bigquery
  • Boston
  • browser
  • Chrome
  • Chrome for Business
  • Chrome Frame
  • Chrome OS
  • chromebooks
  • Chromebooks for Education
  • chromebox
  • City 24/7
  • Clearing Kosovo
  • Cloud
  • cloud computing
  • cloud computing gonegoogle
  • cloud computing gonegoogle Google Apps
  • cloud computing gonegoogle Google Apps google docs small business success story
  • cloud computing gonegoogle Google Apps google docs small business success story switch
  • cloud datastore
  • cloud platform
  • cloud print
  • cloud services
  • cloud sql
  • collaboration
  • Colorado
  • contacts
  • customer love
  • Customer story
  • Customer testimonial
  • Developer
  • developers
  • Docs
  • documents
  • drive storage
  • Earth
  • earth and maps
  • education
  • enterprise
  • events
  • FedEx
  • Fedex.com
  • franchises
  • Gartner
  • GE
  • Global Partner Summit
  • gmail
  • Gone Google
  • gonegoogle
  • Google App Engine
  • Google Apps
  • Google Apps Blog
  • Google Apps Engine
  • Google Apps for Business
  • google apps for education
  • Google Apps for Government
  • Google Apps Reseller
  • Google Apps Script
  • Google Apps Vault
  • Google Calendar
  • Google Cloud Platform
  • google cloud storage
  • google commerce search
  • Google Compute Engine
  • google docs
  • google drive
  • Google Earth
  • Google Earth Enterprise
  • Google Earth Pro
  • Google Enterprise
  • Google Enterprise Search
  • Google Forms
  • Google Green
  • google groups
  • Google Maps
  • Google Maps API
  • Google Maps Coordinate
  • Google Maps Engine
  • Google Maps Engine public data program
  • Google Maps for Business
  • Google Maps Tracks API
  • Google Places API
  • google play for education
  • Google Prediction API
  • Google Search Appliance
  • google sites
  • Google spreadsheets
  • google storage
  • Google Storage for Developers
  • google+
  • Google+ api
  • Google+ Communities
  • googlenew
  • government
  • GSA
  • GSA 7.0
  • guest post
  • HALO Trust
  • Hangout on Air
  • hangouts
  • innovation
  • international trade
  • Internet Explorer
  • intranet
  • iOS
  • iPad
  • IT
  • K-12
  • large business
  • manufacturing
  • Maps
  • marketplace
  • medium business
  • mobile
  • moms
  • Mother's Day
  • NAVMAN
  • new features
  • Niagara International Transportation Technology Coalition
  • non-profit
  • noteworthy
  • offline
  • partner
  • partners
  • Place Summaries
  • Postini
  • productivity
  • Quickoffice
  • Receptionist's Day
  • retail
  • SBW2013
  • Search
  • Security
  • Sheets
  • Slides
  • small business
  • SMB
  • success story
  • support
  • System Admin
  • T Dispatch
  • Transport and Logistics
  • Trust
  • university
  • utilities
  • Veteran Owned Businesses
  • Veterans Day
  • wallet
  • webinar

Blog Archive

  • ▼  2013 (239)
    • ►  December (18)
    • ►  November (25)
    • ►  October (29)
    • ▼  September (19)
      • Amtrak maps trains from coast to coast with Google...
      • SeaPort Airlines takes off with Google Apps
      • Mexico’s Secretaría de la Función Pública brings g...
      • Hangout On Air: Tapping Into Big Data to Discover ...
      • More On Gmail’s Delivery Delays
      • Freeing Quickoffice for Everyone
      • Property management, powered by Chromeboxes
      • CAN Telematics and Google Maps enhance compliance ...
      • Stream your data into BigQuery in real-time
      • Hangout On Air: Speedway Motors Builds a Better St...
      • The HALO Trust: Helping communities reclaim the la...
      • Brazil’s telecom provider, TIM, improves customer ...
      • A fresh mix of Intel-based Chromebooks — something...
      • Back to School in Canada with Chromebooks and Goog...
      • New Hangout On Air Series: How Retailers Innovate ...
      • Four new ways to customize your Google Forms
      • Leon Speakers cranks up the productivity volume wi...
      • Toyota Motor Europe: Visualizing the road ahead wi...
      • LOSTnFOUND uses Google Maps to help reunite people...
    • ►  August (11)
    • ►  July (21)
    • ►  June (26)
    • ►  May (24)
    • ►  April (20)
    • ►  March (13)
    • ►  February (17)
    • ►  January (16)
  • ►  2012 (176)
    • ►  December (18)
    • ►  November (17)
    • ►  October (21)
    • ►  September (15)
    • ►  August (13)
    • ►  July (11)
    • ►  June (19)
    • ►  May (16)
    • ►  April (13)
    • ►  March (9)
    • ►  February (12)
    • ►  January (12)
  • ►  2011 (85)
    • ►  December (14)
    • ►  November (19)
    • ►  October (17)
    • ►  September (21)
    • ►  August (14)
Powered by Blogger.

About Me

Unknown
View my complete profile