Simplify the operational model for your Big Data processing on Google Cloud platform.
Progressively, Connectikpeople.co is seduced by the solid efforts deployed
by the team behind Google Cloud Platform. Increasingly the team improves connectors and
makes Hadoop run better on Google Cloud Platform.
Henceforth, the Preview release of Google BigQuery connector and Google Cloud Datastore
connector for Hadoop, aims to make it easier for you to
run Hadoop jobs directly against your data in Google BigQuery and Google Cloud
Datastore .
If unfamiliar, Connectikpeople.co recalls that, the Google BigQuery and
Google Cloud Datastore connectors implement Hadoop’s InputFormat and OutputFormat interfaces for accessing data. These two connectors complement the
existing Google Cloud Storage
connector for Hadoop, which implements the Hadoop Distributed File
System interface for accessing data in Google Cloud
Storage.
The connectors can be automatically installed and configured when deploying your Hadoop cluster using bdutil simply by including the extra “env” files:
The connectors can be automatically installed and configured when deploying your Hadoop cluster using bdutil simply by including the extra “env” files:
- ./bdutil deploy bigquery_env.sh
- ./bdutil deploy datastore_env.sh
- ./bdutil deploy bigquery_env.sh datastore_env.sh