Skip to content

Instantly share code, notes, and snippets.

View heathermiller's full-sized avatar

Heather Miller heathermiller

View GitHub Profile
@heathermiller
heathermiller / broked.txt
Created February 25, 2016 12:57
courseraprogramming broked
⌘ ~/Desktop courseraprogramming grade local "mah-image.tar" submission
WARNING:py.warnings:/Library/Python/2.7/site-packages/docker/utils/utils.py:591: UserWarning: docker.utils.create_host_config() is deprecated. Please use Client.create_host_config() instead.
'docker.utils.create_host_config() is deprecated. Please use '
WARNING:py.warnings:/Library/Python/2.7/site-packages/requests/packages/urllib3/util/ssl_.py:315: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
SNIMissingWarning
WARNING:py.warnings:/Library/Python/2.7/site-packages/requests/packages/urllib3/util/ssl_.py:120: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may
@heathermiller
heathermiller / fiddle-error.scala
Last active February 29, 2016 09:53
Scala Fiddle error
ScalaFiddle.scala:13: error: constructor cannot be instantiated to expected type;
found : (T1, T2)
required: String
else for (((color, func), i) <- graphs) {
^
ScalaFiddle.scala:14: error: Any does not take parameters
val y = func(x/w * 75) * h/40 + h/count * (i+0.5)
^
ScalaFiddle.scala:14: error: type mismatch;
found : Double(0.5)
@heathermiller
heathermiller / url-disaster
Created March 1, 2016 21:32
url-disaster
--------------------------------------------------------------------------------
Grader output:
================================================================================
{
"fractionalScore": 0.06,
"feedback": "Your overall score for this assignment is 0.65 out of 10.00\n\n\nThe code you submitted did not pass all of our tests: your submission achieved a score of\n0.65 out of 10.00 in our tests.\n\nIn order to find bugs in your code, we advise to perform the following steps:\n - Take a close look at the test output that you can find below: it should point you to\n the part of your code that has bugs.\n - Run the tests that we provide with the handout on your code.\n - The tests we provide do not test your code in depth: they are very incomplete. In order\n to test more aspects of your code, write your own unit tests.\n - Take another very careful look at the assignment description. Try to find out if you\n misunderstood parts of it. While reading through the assignment, write more tests.\n\nBe
@heathermiller
heathermiller / romains-stdout
Created March 3, 2016 15:11
Romain's stdout
{
"fractionalScore": 0.00,
"feedback": "Your overall score for this assignment is 0.00 out of 10.00\n\n\nThe code you submitted did not pass all of our tests: your submission achieved a score of\n0.00 out of 10.00 in our tests.\n\nIn order to find bugs in your code, we advise to perform the following steps:\n - Take a close look at the test output that you can find below: it should point you to\n the part of your code that has bugs.\n - Run the tests that we provide with the handout on your code.\n - The tests we provide do not test your code in depth: they are very incomplete. In order\n to test more aspects of your code, write your own unit tests.\n - Take another very careful look at the assignment description. Try to find out if you\n misunderstood parts of it. While reading through the assignment, write more tests.\n\nBelow you can find a short feedback for every individual test that failed.\n\n======== LOG OF FAILED TESTS ========\nYour solution achieved a testing score of 0 out of 150.\n\nBel

Hey, thanks for the feedback ! yes it is, especially because I'm not trying to solve a concrete problem, but just to find new ideas. But writing the thesis (or at least starting) is even more challenging I found.

Regarding changing the f-p model, I don't think we should. if we manage to have something "pluggable enough", that doesn't force the user to use a specific library, I'd say it's better. About the highlight point with "No !" attached to it: I agree that sharing a root node is useful, no question to that. My point was about sharing the lineage after the root node; apply/flatMap done to it. And more precisely, the case where we don't materialize it, where one node starts applying spore to it, then transfer the lineage without seeing the result first to an other node. That case (and this one only) has little interest in my opinion. If we allow (in our scenario that is) one node to see the result of its lineage before sending it, then I can already think of application such as sharing work ("I've manage

gems:
system:
uname: "Linux stephens 3.2.61-grsec-modsign #1 SMP Tue Aug 12 09:58:26 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux"
system: "ubuntu/12.04/x86_64"
bash: "/bin/bash => GNU bash, version 4.2.25(1)-release (x86_64-pc-linux-gnu)"
zsh: "/usr/bin/zsh => zsh 4.3.17 (x86_64-unknown-linux-gnu)"
rvm:
[stephens]$ gem env
RubyGems Environment:
- RUBYGEMS VERSION: 2.4.8
- RUBY VERSION: 2.2.4 (2015-12-16 patchlevel 230) [x86_64-linux]
- INSTALLATION DIRECTORY: /home/heathercmiller/.rvm/gems
- RUBY EXECUTABLE: /home/heathercmiller/.rvm/rubies/ruby-2.2.4/bin/ruby
- EXECUTABLE DIRECTORY: /home/heathercmiller/.rvm/gems/bin
- SPEC CACHE DIRECTORY: /home/heathercmiller/.gem/specs
- SYSTEM CONFIGURATION DIRECTORY: /etc
- RUBYGEMS PLATFORMS:
@heathermiller
heathermiller / CS4240.txt
Created September 25, 2016 13:05
CS4240
CS 6240: Parallel Data Processing
This course covers techniques for managing and analyzing very large data sets,
with an emphasis on approaches that scale out effectively as more compute nodes
are added. Principles of distributed data management and strategies for
problem-driven data partitioning are introduced through a selection of design
patterns from various application domains, including graph analysis, databases,
text processing, and data mining. Coursework includes hands-on programming
experience with modern big-data processing technology such as MapReduce, Spark,
HBase, and Cloud Computing. (This selection is subject to change as technology
@heathermiller
heathermiller / desc.txt
Last active September 28, 2016 16:32
Desc
My colleague Heather Miller and I have been discussing a new project that would
focus on increasing the reliability and performance of applications based on
Apache’s “Spark” engine for big data processing. The programming model we aim to
improve seeks to achieve parallelism via distribution, by transmitting
computations (closures) to a collection of sites where distributed data resides.
The work we have in mind would have two areas of focus: (i) design,
implementation, and evaluation of programming models that make this paradigm of
shipping computations to distributed data more robust and usable, and less error
prone (e.g., to avoid races, memory leaks, etc.) and (ii) design,
implementation, and evaluation of tools for analyzing and refactoring of Spark
@heathermiller
heathermiller / timeusage.md
Created April 14, 2017 13:05
Time Usage Assignment Instructions