Naoya Moritani n0531m

Gemini Agent: Core Directives and Operating Protocols

Extract metadata from Data Studio

this is some example code I used to extract metadata (REPORT/DATA_SOURCE) from Data Studio.

Warning : Information provided via Data Studio API very limited. So if you are looking for ways to understand more details such as what are the constructs of a REPORT or what backend a DATA_SOURCE is connecting to, unfortunately these will not help. That said, it can still be better than nothing so that you know what assets are existing within the organization.

Extracted information can be potentially cataloged in some other services such as Data Catalog. However, that is beyond what this sample covers.

products in use

Overview

this is my quick note of attempting to load Indonesia's admin boundaries into BigQuery

Source

Indonesia - Subnational Administrative Boundaries Humanitarian Data Exchange
- License : Creative Commons Attribution for Intergovernmental Organisations (CC BY-IGO) https://data.humdata.org/about/license

Good pre-read :

How to load geographic data like shapefiles into BigQuery (by Lak)

	#!/bin/bash

	## Licensed under the Apache License, Version 2.0 (the "License");
	## you may not use this file except in compliance with the License.
	## You may obtain a copy of the License at
	##
	## https://www.apache.org/licenses/LICENSE-2.0
	##
	## Unless required by applicable law or agreed to in writing, software
	## distributed under the License is distributed on an "AS IS" BASIS,

	#!/bin/bash

	##Source : Cloud SQL Instance/Table/SQL for extraction
	CLOUDSQL_INSTANCE_PROJECT=imfeelinglucky-utilities
	CLOUDSQL_INSTANCE_REGION=asia-southeast1
	CLOUDSQL_INSTANCE_NAME=testmysql57
	CLOUDSQL_INSTANCE_USERNAME=
	CLOUDSQL_INSTANCE_USERPASS=
	CLOUSSQL_SQL="select * from mysql.user"

	<?xml version="1.0" encoding="UTF-8"?>
	<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
	<groupId>com.gmail.n0531m</groupId>
	<artifactId>postgresql_${postgresql.version}-with-cloudsql-socket-factory_${postgresql.socketfactory.version}</artifactId>
	<packaging>pom</packaging>
	<version>0.0.1-SNAPSHOT</version>
	<prerequisites>
	<maven>3.6.0</maven>
	</prerequisites>

	<?xml version="1.0" encoding="UTF-8"?>
	<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
	<groupId>com.gmail.n0531m</groupId>
	<artifactId>mysql_${mysql.version}-with-cloudsql-socket-factory_${cloudsql.socketfactory.version}</artifactId>
	<packaging>pom</packaging>
	<version>0.0.1</version>
	<prerequisites>
	<maven>3.6.0</maven>
	</prerequisites>

	##!/bin/bash

	## setting up the least to a clean linux env on a chromebook
	## mostly a copy&paste from instructions found on the web, which is why the approach is not consistent...
	## i might clean it up in the future but as long as it works it does the job.

	sudo apt-get update
	sudo apt-get upgrade

	sudo apt-get install apt-transport-https ca-certificates gnupg software-properties-common apt-utils

	#
	# https://en.wikipedia.org/wiki/Radian
	# https://towardsdatascience.com/calculating-the-bearing-between-two-geospatial-coordinates-66203f57e4b4

	CREATE TEMP FUNCTION
	PI (degree float64) AS (ACOS(-1));

	CREATE TEMP FUNCTION
	RADIANS (degree FLOAT64) AS (degree * ACOS(-1) / 180);
	CREATE TEMP FUNCTION

	data/
	.DS_Store