Tech Support EX

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Wednesday, 18 September 2013

Stream your data into BigQuery in real-time

Posted on 08:00 by Unknown
Posted by Ju-kay Kwek, BigQuery Product Manager

Today, we live in a world where businesses are generating large amounts of real-time data from web applications that serve millions of users, online sales transactions, or customer activity created by an explosion of connected devices. Being able to react quickly to changes in the data being generated is critical to remain competitive. At the same time, businesses are gathering, storing and analyzing data -- sometimes 100s of gigabytes per day -- using legacy systems that struggle to keep up.

We built Google BigQuery to enable businesses to tackle this problem without having to invest in costly and complex infrastructure. And today this gets even easier with two key new features:

  • Real-time data streaming: you can now stream events row-by-row into BigQuery via a simple new API call. This enables you to store data as it comes in, rather than building and maintaining systems just to cache and upload in batches. The best part? The new data is available for querying instantaneously. Streaming ingestion is free for an introductory period until January 1st, 2014. After that it will be billed at a flat rate of 1 cent per 10,000 rows inserted. The existing batch-based ingestion will continue to be free.
  • Query portions of a table: you can now query a specific subset of a table using a simple new @<t> that we call a “table decorator” in your SQL statements. Though restricted to data inserted within the last 24 hours, this capability provides significant benefits beyond just cost efficiency -- for example, in conjunction with real-time data streaming, you can now use table decorators to monitor the last 30 minutes of user activity after a new change is pushed to your application.


In addition to these features, we’ve also expanded BigQuery’s window functions to include SUM and COUNT -- statistical capabilities that many customers have asked for -- as well as regular analytic functions for calculating Correlation and Standard Deviation.

And to make the entire querying experience smoother, the BigQuery user interface has also received numerous productivity-enhancing updates. These include an expanding information panel when clicking on a query, as well as action buttons at the bottom of the query box to make it easier to edit, run, save, and show results.

You can get details about these new capabilities and examples from our Developer Blog and in our updated product documentation.

Whether it’s for capturing streams of application event logging or real-time user behavior analysis, we can’t wait to hear how you’re using BigQuery’s new features. And we hope you’ll share with our community via the #BigQuery tag on Google+.
Email ThisBlogThis!Share to XShare to Facebook
Posted in Big Query | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • Mapping a clear strategy for business growth with Google
    Posted by A.V. Dharmakrishnan, Chief Executive Officer, Madras Cements Editor's note: Today’s guest is A.V. Dharmakrishnan, Chief Exec...
  • Building a better map of Europe
    Posted by Brian McClendon, Vice President, Google Maps and Google Earth Whether your business is building a solution to map gas pipelines or...
  • Google Apps domain registration has gone global
    Posted by Hugues Vincent, Google Apps team A country code top-level domain (ccTLD) such as .com.es or .jp helps companies build a local foot...
  • Cloud computing enabling entrepreneurship in Africa
    Posted by Zafir Khan, Google App Engine Team (Cross-posted on the Official Google Blog .) In 2007, 33-year-old Vuyile moved to Cape Town f...
  • A financial perspective on moving to the cloud
    Posted by Alandha Scott, Google Apps Team Editors note: Chief Financial Officers are key decision-makers in any organization’s move to th...
  • School of Rock tops the charts with Google Apps for Business and Chromebooks
    Posted by Evan Trent, Vice President of Digital Strategy and Technology, School of Rock Editors note: Today’s guest blogger is Evan Trent, ...
  • Enhanced email management for user groups
    Posted by Adam Dawes, Product Manager, Google Apps Google Apps delivers a stream of innovation that brings new features to end users. That s...
  • QAD improves service and support for global customer base with the Google Search Appliance
    Posted by Scott Lawson, director of IT architecture, QAD Editors note: Today’s guest blogger is Scott Lawson, director of IT architecture f...
  • How to get to the cloud: 5 easy steps
    Posted by Eric Schmidt, Executive Chairman, Google Earlier this month, I delivered a keynote at Gartner’s annual symposium and published a ...
  • One click to Docs, Sheets, and Slides
    Posted by Jonathan Rochelle, Director of Product Management (Cross-posted from the Google Drive Blog .) Google Drive is a place where you...

Categories

  • #gone google
  • #gonegoogle
  • #Google Apps
  • #innovationupgrade
  • #moregoogleapps
  • #SysAdminDay
  • #tbt
  • #throwbackthursday
  • #top10trust
  • 100% web
  • admin
  • admin sdk
  • Android
  • Apps
  • Apps Adventures
  • Asia Pacific
  • Audi
  • Audi Connect
  • Australia
  • big data
  • Big Query
  • bigquery
  • Boston
  • browser
  • Chrome
  • Chrome for Business
  • Chrome Frame
  • Chrome OS
  • chromebooks
  • Chromebooks for Education
  • chromebox
  • City 24/7
  • Clearing Kosovo
  • Cloud
  • cloud computing
  • cloud computing gonegoogle
  • cloud computing gonegoogle Google Apps
  • cloud computing gonegoogle Google Apps google docs small business success story
  • cloud computing gonegoogle Google Apps google docs small business success story switch
  • cloud datastore
  • cloud platform
  • cloud print
  • cloud services
  • cloud sql
  • collaboration
  • Colorado
  • contacts
  • customer love
  • Customer story
  • Customer testimonial
  • Developer
  • developers
  • Docs
  • documents
  • drive storage
  • Earth
  • earth and maps
  • education
  • enterprise
  • events
  • FedEx
  • Fedex.com
  • franchises
  • Gartner
  • GE
  • Global Partner Summit
  • gmail
  • Gone Google
  • gonegoogle
  • Google App Engine
  • Google Apps
  • Google Apps Blog
  • Google Apps Engine
  • Google Apps for Business
  • google apps for education
  • Google Apps for Government
  • Google Apps Reseller
  • Google Apps Script
  • Google Apps Vault
  • Google Calendar
  • Google Cloud Platform
  • google cloud storage
  • google commerce search
  • Google Compute Engine
  • google docs
  • google drive
  • Google Earth
  • Google Earth Enterprise
  • Google Earth Pro
  • Google Enterprise
  • Google Enterprise Search
  • Google Forms
  • Google Green
  • google groups
  • Google Maps
  • Google Maps API
  • Google Maps Coordinate
  • Google Maps Engine
  • Google Maps Engine public data program
  • Google Maps for Business
  • Google Maps Tracks API
  • Google Places API
  • google play for education
  • Google Prediction API
  • Google Search Appliance
  • google sites
  • Google spreadsheets
  • google storage
  • Google Storage for Developers
  • google+
  • Google+ api
  • Google+ Communities
  • googlenew
  • government
  • GSA
  • GSA 7.0
  • guest post
  • HALO Trust
  • Hangout on Air
  • hangouts
  • innovation
  • international trade
  • Internet Explorer
  • intranet
  • iOS
  • iPad
  • IT
  • K-12
  • large business
  • manufacturing
  • Maps
  • marketplace
  • medium business
  • mobile
  • moms
  • Mother's Day
  • NAVMAN
  • new features
  • Niagara International Transportation Technology Coalition
  • non-profit
  • noteworthy
  • offline
  • partner
  • partners
  • Place Summaries
  • Postini
  • productivity
  • Quickoffice
  • Receptionist's Day
  • retail
  • SBW2013
  • Search
  • Security
  • Sheets
  • Slides
  • small business
  • SMB
  • success story
  • support
  • System Admin
  • T Dispatch
  • Transport and Logistics
  • Trust
  • university
  • utilities
  • Veteran Owned Businesses
  • Veterans Day
  • wallet
  • webinar

Blog Archive

  • ▼  2013 (239)
    • ►  December (18)
    • ►  November (25)
    • ►  October (29)
    • ▼  September (19)
      • Amtrak maps trains from coast to coast with Google...
      • SeaPort Airlines takes off with Google Apps
      • Mexico’s Secretaría de la Función Pública brings g...
      • Hangout On Air: Tapping Into Big Data to Discover ...
      • More On Gmail’s Delivery Delays
      • Freeing Quickoffice for Everyone
      • Property management, powered by Chromeboxes
      • CAN Telematics and Google Maps enhance compliance ...
      • Stream your data into BigQuery in real-time
      • Hangout On Air: Speedway Motors Builds a Better St...
      • The HALO Trust: Helping communities reclaim the la...
      • Brazil’s telecom provider, TIM, improves customer ...
      • A fresh mix of Intel-based Chromebooks — something...
      • Back to School in Canada with Chromebooks and Goog...
      • New Hangout On Air Series: How Retailers Innovate ...
      • Four new ways to customize your Google Forms
      • Leon Speakers cranks up the productivity volume wi...
      • Toyota Motor Europe: Visualizing the road ahead wi...
      • LOSTnFOUND uses Google Maps to help reunite people...
    • ►  August (11)
    • ►  July (21)
    • ►  June (26)
    • ►  May (24)
    • ►  April (20)
    • ►  March (13)
    • ►  February (17)
    • ►  January (16)
  • ►  2012 (176)
    • ►  December (18)
    • ►  November (17)
    • ►  October (21)
    • ►  September (15)
    • ►  August (13)
    • ►  July (11)
    • ►  June (19)
    • ►  May (16)
    • ►  April (13)
    • ►  March (9)
    • ►  February (12)
    • ►  January (12)
  • ►  2011 (85)
    • ►  December (14)
    • ►  November (19)
    • ►  October (17)
    • ►  September (21)
    • ►  August (14)
Powered by Blogger.

About Me

Unknown
View my complete profile