natea

2015-09-22 13:36:48,424 INFO 20505 [luigi-interface] worker.py:267 - Scheduled ImportEnrollmentsIntoMysql(source=('hdfs://localhost:9000/data/',), expand_interval=2 days, 0:00:00, pattern=('.*tracking.log.*',), warehouse_path=hdfs://localhost:9000/edx-analytics-pipeline/warehouse/, interval=None) (PENDING)
2015-09-22 13:36:48,427 INFO 20505 [luigi-interface] worker.py:267 - Scheduled EnrollmentDailyTask(source=('hdfs://localhost:9000/data/',), expand_interval=2 days, 0:00:00, pattern=('.*tracking.log.*',), database=reports, credentials=/edx/etc/edx-analytics-pipeline/output.json, warehouse_path=hdfs://localhost:9000/edx-analytics-pipeline/warehouse/, overwrite=True, hive_overwrite=False, interval=2013-11-01-2015-09-23) (PENDING)
2015-09-22 13:36:52,524 INFO 20505 [luigi-interface] worker.py:267 - Scheduled ImportAuthUserProfileTask(overwrite=False, destination=hdfs://localhost:9000/edx-analytics-pipeline/warehouse/, credentials=/edx/etc/edx-analytics-pipeline/input.json, import_date=None) (PENDING)
2015-09-22

natea

Running command = ['ssh', '-tt', '-o', 'ForwardAgent=yes', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'KbdInteractiveAuthentication=no', '-o', 'PasswordAuthentication=no', '-o', 'User=vagrant', '-o', 'ConnectTimeout=10', '-p', '2222', '-i', '/Users/nateaune/.vagrant.d/boxes/analyticstack/0/virtualbox/vagrant_private_key', '127.0.0.1', "sudo -Hu hadoop /bin/bash -c 'cd /var/lib/analytics-tasks/devstack/repo && . $HOME/.bashrc && /var/lib/analytics-tasks/devstack/venv/bin/launch-task  AnswerDistributionWorkflow --local-scheduler --src hdfs://localhost:9000/data/ --include *tracking.log* --dest hdfs://localhost:9000/edx-analytics-pipeline/output/answer_distribution_raw//data --name --output-root hdfs://localhost:9000/edx-analytics-pipeline/output/answer_distribution/ --marker hdfs://localhost:9000/edx-analytics-pipeline/output/answer_distribution_raw//marker --n-reduce-tasks 1'"]
Warning: Permanently added '[127.0.0.1]:2222' (RSA) to the list of known hosts.
DEBUG:stevedore.ext

natea

2015-09-22 11:51:34,841 INFO 12850 [luigi-interface] hadoop.py:234 - FAILED: SemanticException [Error 10001]: Line 25:16 Table not found 'auth_userprofile'
2015-09-22 11:51:34,980 ERROR 12850 [luigi-interface] worker.py:304 - [pid 12850] Worker Worker(salt=039843096, host=precise64, username=hadoop, pid=12850) failed    HiveTableFromParameterQueryTask(overwrite=False, warehouse_path=hdfs://localhost:9000/edx-analytics-pipeline/warehouse/, insert_query=
            SELECT
                ce.date,
                ce.course_id,
                CASE p.level_of_education
                    WHEN 'el'    THEN 'primary'
                    WHEN 'jhs'   THEN 'junior_secondary'
                    WHEN 'hs'    THEN 'secondary'
                    WHEN 'a'     THEN 'associates'

natea

2015-09-22 11:49:40,371 INFO 12850 [luigi-interface] worker.py:282 - [pid 12850] Worker Worker(salt=039843096, host=precise64, username=hadoop, pid=12850) running   SqoopImportFromMysql(overwrite=False, destination=hdfs://localhost:9000/edx-analytics-pipeline/warehouse/auth_userprofile/dt=2015-09-22/, credentials=/edx/etc/edx-analytics-pipeline/input.json, database=edxapp, num_mappers=None, verbose=False, table_name=auth_userprofile, where=None, columns=('user_id', 'gender', 'year_of_birth', 'level_of_education'), null_string=\\N, fields_terminated_by=, delimiter_replacement= , mysql_delimiters=False)
mkdir: `/tmp/luigi/partial/luigi/partial': No such file or directory
Exception AttributeError: AttributeError('_process',) in <bound method HdfsAtomicWritePipe.__del__ of <luigi.hdfs.HdfsAtomicWritePipe object at 0x40018d0>> ignored
2015-09-22 11:49:45,372 ERROR 12850 [luigi-interface] worker.py:304 - [pid 12850] Worker Worker(salt=039843096, host=precise64, username=hadoop, pid=12850) failed    SqoopImportFromM

natea

$ remote-task --vagrant-path ~/Dropbox/code/analyticstack --remote-name devstack --override-config ${PWD}/config/devstack.cfg --wheel-url $WHEEL_URL --wait \
   ImportEnrollmentsIntoMysql --local-scheduler --interval-end $(date -v+1d +%Y-%m-%d) --n-reduce-tasks 1
Parsed arguments = Namespace(branch='release', host=None, job_flow_id=None, job_flow_name=None, launch_task_arguments=['ImportEnrollmentsIntoMysql', '--local-scheduler', '--interval-end', '2015-09-22', '--n-reduce-tasks', '1'], log_path=None, override_config='/Users/nateaune/Dropbox/code/edx-analytics-pipeline/config/devstack.cfg', private_key=None, remote_name='devstack', repo=None, secure_config=None, secure_config_branch=None, secure_config_repo=None, shell=None, skip_setup=False, sudo_user='hadoop', user=None, vagrant_path='/Users/nateaune/Dropbox/code/analyticstack', verbose=False, wait=True, wheel_url='http://edx-wheelhouse.s3-website-us-east-1.amazonaws.com/Ubuntu/precise', workflow_profiler=None)
Running commands from path = /Users/nateaune/D

natea

TASK: [analytics tasks repository checked out] ********************************
failed: [127.0.0.1] => {"cmd": "/usr/bin/git ls-remote origin -h refs/heads/release", "failed": true, "rc": 128}
stderr: Warning: Permanently added the RSA host key for IP address '192.30.252.130' to the list of known hosts.
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

msg: Warning: Permanently added the RSA host key for IP address '192.30.252.130' to the list of known hosts.

natea

Sep 20 22:34:27 precise64 [service_variant=insights][django.request][env:no_env] ERROR [precise64  14380] [base.py:231] - Internal Server Error: /courses/course-v1:edX+DemoX+Demo_Course/engagement/content/
Traceback (most recent call last):
  File "/edx/app/insights/venvs/insights/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 111, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/edx/app/insights/venvs/insights/local/lib/python2.7/site-packages/django/views/generic/base.py", line 69, in view
    return self.dispatch(request, *args, **kwargs)
  File "/edx/app/insights/edx_analytics_dashboard/analytics_dashboard/courses/views/__init__.py", line 61, in dispatch
    return super(CourseAPIMixin, self).dispatch(request, *args, **kwargs)
  File "/edx/app/insights/edx_analytics_dashboard/analytics_dashboard/courses/views/__init__.py", line 397, in dispatch
    return super(CourseView, self).dispatch(request, *args, **kwargs)

natea

==> default: Exporting NFS shared folders...
NFS is reporting that your exports file is invalid. Vagrant does
this check before making any changes to the file. Please correct
the issues below and execute "vagrant reload":

exports:15: path contains non-directory or non-existent components: /Users/nateaune/Dropbox/code/cypress-rc4/cs_comments_service
exports:15: no usable directories in export entry
exports:15: using fallback (marked offline): /
exports:16: path contains non-directory or non-existent components: /Users/nateaune/Dropbox/code/cypress-rc4/edx-platform
exports:16: no usable directories in export entry

natea

Environment:


Request Method: POST
Request URL: http://localhost:8000/accounts/confirm-email/3haxscwlz4pj3ygnh61zxsq8fbunam2kj1my5lewtylap6gqec4kh0ludwsyirfh/

Django Version: 1.8.3
Python Version: 2.7.8
Installed Applications:
['django.contrib.auth',

natea

[10:02am] <natea>
any have experience with translating text in Open edX who could help us out with this issue? https://groups.google.com/forum/#!topicsearchin/openedx-ops/i18n$20workflow/openedx-ops/cmVT61NHSsU
[10:39am]
jbkc85 joined the chat room.
[10:40am] <natea>
singingwolfboy: do you know who at edX is familiar with i18n issues?
[10:40am] <natea>
nedbat: ^^^
[10:40am] <singingwolfboy>