Simplify the operational model for your Big Data processing on Google Cloud platform.



Progressively, Connectikpeople.co is seduced by the solid efforts deployed by the team behind Google Cloud Platform. Increasingly the team improves connectors and makes Hadoop run better on Google Cloud Platform.
Henceforth, the Preview release of Google BigQuery connector and Google Cloud Datastore connector for Hadoop, aims to make it easier for you to run Hadoop jobs directly against your data in Google BigQuery and Google Cloud
Datastore .
If unfamiliar, Connectikpeople.co recalls that, the Google BigQuery and Google Cloud Datastore connectors implement Hadoop’s InputFormat and OutputFormat interfaces for accessing data. These two connectors complement the existing Google Cloud Storage connector for Hadoop, which implements the Hadoop Distributed File System interface for accessing data in Google Cloud Storage.

The connectors can be
automatically installed and configured when deploying your Hadoop cluster using bdutil simply by including the extra “env” files:
  • ./bdutil deploy bigquery_env.sh
  • ./bdutil deploy datastore_env.sh
  • ./bdutil deploy bigquery_env.sh datastore_env.sh


This means that, your data is available simultaneously to multiple Big Data clusters and other services, without duplications.

Popular Posts