Skip to content

Instantly share code, notes, and snippets.

View brianrodri's full-sized avatar
😎

Brian Rodriguez brianrodri

😎
51 followers · 22 following
View GitHub Profile
@brianrodri
brianrodri / index.html
Created September 29, 2016 16:35
Exported from Popcode. Click to import: https://popcode.org/?gist=051125d4438374c521936bcecbd8106f
<!DOCTYPE html>
<html>
<head>
<title>Page Title</title>
</head>
<body>
</body>
</html>
@brianrodri
brianrodri / index.html
Created September 29, 2016 16:35
Exported from Popcode. Click to import: https://popcode.org/?gist=e3023071695405024135724ff22bdb39
<!DOCTYPE html>
<html>
<head>
<title>Page Title</title>
</head>
<body>
</body>
</html>
@brianrodri
brianrodri / index.html
Created October 31, 2016 20:07
Exported from Popcode. Click to import: https://popcode.org/?gist=445b0becabc47f7758defb6afc3f4d68
<!DOCTYPE html>
<html>
<head>
<title>Do Now 4.1.0</title>
</head>
<body>
<div id="green"></div>
<div id="yellow"></div>
<div id="blue"></div>
<div id="red"></div>
@brianrodri
brianrodri / index.html
Created October 31, 2016 20:07
Exported from Popcode. Click to import: https://popcode.org/?gist=cc74aafc7ef8515aae00604d488067bd
<!DOCTYPE html>
<html>
<head>
<title>Do Now 4.1.0</title>
</head>
<body>
<div id="green"></div>
<div id="yellow"></div>
<div id="blue"></div>
<div id="red"></div>
@brianrodri
brianrodri / index.html
Created October 31, 2016 20:09
Exported from Popcode. Click to import: https://popcode.org/?gist=7a5e8e5c0ba0d573ab0443a5fabaa7e7
<!DOCTYPE html>
<html>
<head>
<title>Mini-Activity 4.1.0</title>
</head>
<body>
<div id="green"></div>
<div id="yellow"></div>
<div id="blue"></div>
<div id="red"></div>
@brianrodri
brianrodri / base_human_maintained_model.py
Created October 19, 2020 17:46
class BaseHumanMaintainedModel(BaseModel):
"""A model that tracks the last time it was updated by a human.
When the model is updated by a human, use `self.put_by_human()` to store it.
For example: after the title of an exploration is changed by its creator.
Otherwise, when the model is updated by some non-human or automated process,
use `self.put()`. For example: by a one-off job updating the schema version
of a property.
@brianrodri
brianrodri / schema_migration_beam_jobs.py
Last active January 15, 2021 01:27
LATEST_VERSION_SENTINAL = object()
MIGRATION_FUNCTIONS_REGISTRY = {
exp_models.ExplorationModel: {
1: exp_services.migrate_schema_v1_to_v2,
2: exp_services.migrate_schema_v2_to_v3,
3: LATEST_VERSION_SENTINAL,
},
}
class SchemaMigrationTransform(beam.PTransform):
@brianrodri
brianrodri / base_model_validation_errors.py
Last active February 15, 2021 12:12
class ModelValidationError(object):
@property
def key(self):
return self.__class__.__name__
@property
def message(self):
return None
@brianrodri
brianrodri / gist:771e599a64653f7d0007585a7031140d
Last active June 24, 2021 07:23

Oppia and Apache Beam

Apache Beam is used by Oppia to perform large-scale operations on the datastore. There are two types of operations:

  • Batch: Operations that are designed to be executed once on the "current state" of the datastore.

    Examples:

    • Count the # of models in the datastore

  • Update the StringProperty values of all models with a specific kind

@brianrodri
brianrodri / sample.py
Last active June 27, 2021 12:35
# FILE: jobs/blog_validation_jobs.py
from jobs import base_jobs
from jobs.io import ndb_io
from jobs.types import blog_validation_errors
import apache_beam as beam
class BlogUniquenessJob(base_jobs.JobBase):