- To create a new dataset, click Share dataset in the upper left panel.
- You will be prompted to input the following:
- Dataset name. Be sure to choose a name that is both descriptive and easily distinguished from other datasets.
- Layer types. This is a menu where you can select multiple layer types (buildings, roads, etc.)
- Description of what you are uploading. Be sure to include any information that our operators should know about your dataset.
- (Optional) Google representative email address, in case you are working with a Google representative.
Layer types
- Road closures
- Geocodes
- Bike lanes
- Land parcels
- Maps/images
- Parks
- Points of interest
- Political
- Postal codes
- Roads
- Trails
- Water bodies
- Housing developments
- Indoor mapping data format (IMDF)
- EV charging station
- Trucking restrictions
- Other
- Select Continue to next step. This will open the Share dataset dialog, which allows you to select how you want to share your data, and to verify that we can automatically retrieve it. Based on your responses, there are three different pathways for sharing your data: a pull feed, a website URL, and a manually submitted datafile.
Set up a pull feed
To set up a pull feed, you must select the delivery option Google can get data via my website, and answer Yes to both subsequent questions.
What makes my link eligible for an automated pull feed?
A data link can be turned into an automated feed when the following two conditions are met:
- When the link is clicked, the associated file will start to download. Note that both the valid and invalid link examples shown here are for the same data, but the first one represents the actual file (eligible), and the second is from the data portal (ineligible).
- Valid link example: https://opendata.arcgis.com/api/v3/datasets/b6bda0e1886f4619952cda1be6f703b8_1/downloads/data?format=shp&spatialRefId=4326&where=1%3D1
- Invalid link example: https://gisdata-wsdot.opendata.arcgis.com/datasets/b6bda0e1886f4619952cda1be6f703b8_1/explore?location=46.721415%2C-120.720950%2C5.57
- The link must remain stable and unchanged after updates are made.
- Example: if the link was previously https://opendata.arcgis.com/api/v3/datasets/b6bda0e1886f4619952cda1be6f703b8_1/01012024/downloads/data?format=shp and the next version is https://opendata.arcgis.com/api/v3/datasets/b6bda0e1886f4619952cda1be6f703b8_1/06012024/downloads/data?format=shp, we can see that the link changes based on the version of the data, making it ineligible for an automated pull feed.
Note: Most datasets hosted on ESRI, ARCGIS, AWS, and various other servers can be turned into a feed
Test your link to confirm whether it's eligible for an automated pull feed
If your data link satisfies the previous conditions, we highly encourage you to create a pull feed dataset. Follow these steps to test whether your link is eligible for a feed, and to find the associated feed/download link attached to your dataset:
- Navigate to your data portal.
Example:
- Download the dataset you want to turn into a feed (the shapefile version is the preferred format).
Example:
- Once downloaded, navigate to your browser's Downloads folder (for Chrome browser, press Ctrl+J).
- Right-click on the file and click Copy link address.
Example:
- With the link copied, paste it into a new tab in your browser and search. Depending on your browser and operating system, either a file will start to download automatically, or you will be prompted to save a file.
- If successful, you have confirmed that your link is eligible. If not, please proceed with either a manual upload or a website URL.
After selecting Yes for both questions, you will automatically be taken to the feed setup dialog.
- Fill in the dialog as follows:
- Delivery method:
- HTTP
- HTTPS
- URL type (more coming soon):
- Single files
- Pull URL: paste the URL(s) you are setting up
- + Add pull URL: to add more than one pull URL
- How often you update your data:
- Daily
- Weekly
- Monthly
- Quarterly
- Annually
Note: The frequency you set here is simply the requested fetch frequency. We will try to accommodate your requested time, but there is no strict guarantee.
- Once you have filled all necessary fields and clicked Submit, you will see a confirmation message.
- Click View newly created dataset to review your upload.
Once the file transfer is complete, your dataset will be updated with a new version and the attached data file.
Update a pull feed
- Click Update data in the upper right corner.
- Select an option from the Update data menu:
- Pull now. This will trigger the feed to pull a new version of the data.
- Edit feed configuration. This will open the Edit feed configuration dialog, where you can make edits to the pull URL, update frequency, and authentication requirement.
- Upload new version: You can manually upload your data file by dragging a copy into this upload window, or by clicking the upload icon to browse for your file. Then click Submit.
Troubleshoot a failed pull feed
- Click Update data > Edit feed configuration.
- Edit the feed configuration to correct the indicated error.
Note: The most common issues are with the pull URL or required authentication.
- Click Update data > Pull now.
- You should see the message Pull is in progress! Click Ok, got it.
- Revisit this page to confirm that your data downloaded successfully.
Note: If there are subsequent errors with fetching your data, there will be additional comments left in the Communication section.
Upload via a website URL
1. Enter the Website URL, Download instructions, and Update frequency, then click Continue.
2. (Optional) To assist in updating your data, you can manually upload your data file by dragging a copy into the upload window, or by clicking the upload icon to browse for your file. Then click Submit.
- Alternatively, click Skip and submit if you do not want to upload your data manually.
Note: Uploading your files will speed up processing and help to ensure the correct data is used, but it is completely optional. We will make a best-effort attempt to use your data regardless.
- After clicking Submit or Skip and submit, you will see a confirmation message.
- Click View newly created dataset to review the new upload.
Update a website URL upload
If no data was manually uploaded, your dataset will have a warning message appended to it. This message will remain until an operator begins working on your data, or until you update your data and include a data file.
If you decide you would like to update your data before an operator gets to it:
- Click Update data > Upload new data in the upper right corner.
- Drag and drop or browse for the data file.
- Press Submit and your data file will be uploaded.
|
If you want to update your data acquisition settings (Website URL, Download instructions, Update frequency):
|
Turning a website URL into an automated pull feed
Before you set up an automated pull feed, see the criteria for an automated pull feed to determine if your website URL is eligible.
- Expand the Data acquisition section in the right-side panel.
- Click the ⋮ menu.
- Click Set up feed configuration.
- Follow the instructions for setting up your pull feed.
Manually upload data
- Choose the files you want to upload. Ensure you have read our content requirements before uploading, to ensure optimal results.
- Click Submit, and you will see a confirmation message.
- Click View newly created dataset to review the new upload.
Update a manual upload
If you want to update your data:
- Click Update data in the upper right corner.
- Select Upload new version.
- Drag and drop or browse for the data file.
- Press Submit, and your data file will be uploaded.
Convert a manually uploaded dataset into an automated pull feed
Before you can set up an automated pull feed, see the criteria for an automated pull feed to determine if your website URL is eligible.
- Expand the Data acquisition section in the right-side panel.
- Click the ⋮ menu.
- Click Set up feed configuration.
- Follow the instructions for setting up your pull feed.
