2024年5月13日~16日まで、米国ラスベガスのVenetianで開催されるInspire 2024をお見逃しなく!皆様のお申し込みをお待ちしております。

 
Data Engineering Template:

Work with Flows Using Public BigQuery Datasets

Use OpenStreetMap data and generate value using Dataprep and BigQuery

Bigquery Public Data – OpenStreetMap Flow The flow view of this template

Transformations:
array parsing (flatten, unnest), pivot, filtering (keep), rename

This template flow shows you how to work with OpenStreetMap data in public Bigquery datasets. It also illustrates several important Google Cloud Dataprep features such as custom SQL, flow and dataset parameterization.

This flow comes with detailed annotation of each step in the recipe. To use this template, follow the following steps:

1) Go to openstreetmap.org and type in a location you want to use as the center of your search. Make note of the latitude and longitude.

2) Follow the annotations in the flow and right click on the Openstreetmap data source and select “Edit Custom SQL” to see the parameters defined, and override the default latitude and longitude to what you have selected from step 1.

3) Choose the OSM parsing recipe and select “+” Create Output to run. Click “Run” to bring up additional configuration options. You can override all of the parameters that were defined in the data source in step 2. There’s also a new parameter called amenity that allows you to select the type of POIs (point of interest) such as restaurant, cafe, atm… etc. that you want to see in your output. You can also configure the distance to search in meters via the distance_meters parameter.

Fore more information, please check out this video demonstrating the use of this flow template in Google Cloud Dataprep.

New to Dataprep?

You will be directed to Dataprep on Google Cloud. You can find this template on the product home page.

Use in Dataprep

Start your 30-day free trial