Skip to content

Update FirehoseJob.py #74

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
webcoderz merged 25 commits into from
Aug 18, 2020
Merged

Update FirehoseJob.py #74

Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
e79ba8e
Update FirehoseJob.py
webcoderz Jun 30, 2020
938aafc
Add files via upload
webcoderz Jun 30, 2020
25c1419
Add files via upload
webcoderz Jul 1, 2020
79c67c7
Delete Twint.py
webcoderz Jul 1, 2020
31e043c
Add files via upload
webcoderz Jul 1, 2020
3ef9408
Add files via upload
webcoderz Aug 6, 2020
eda4748
Delete Twint.py
webcoderz Aug 6, 2020
09516d9
adding twint source into modules
webcoderz Aug 6, 2020
d53c0a2
fix: keine Idee
Aug 7, 2020
3a4d796
non rapids agent dockerfile and tor on compose
webcoderz Aug 16, 2020
4991940
non rapids agent dockerfile and tor on compose
webcoderz Aug 16, 2020
c50b32e
non rapids agent dockerfile and tor on compose
webcoderz Aug 16, 2020
d5da7cc
non rapids agent dockerfile and tor on compose
webcoderz Aug 16, 2020
4ae4159
non rapids agent dockerfile and tor on compose
webcoderz Aug 16, 2020
9a4b167
Update TwintPool.py
webcoderz Aug 16, 2020
ca76ad8
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
0b6f89c
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
df9cdcb
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
dbb2453
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
787ee84
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
b889a27
Create nonrapids-entrypoint.sh
webcoderz Aug 16, 2020
c122341
Update nonrapids-entrypoint.sh
webcoderz Aug 16, 2020
a2d4295
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
d17cb6f
Update nonrapids-Dockerfile
webcoderz Aug 16, 2020
9e9792a
add twint, pandas
webcoderz Aug 16, 2020
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update nonrapids-Dockerfile
  • Loading branch information
@webcoderz
webcoderz authored Aug 16, 2020
commit ca76ad8123bee569dd74d7e7aff45aabc7af9a38
4 changes: 2 additions & 2 deletions infra/pipelines/docker/nonrapids-Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ RUN apt-get update \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*

COPY ./app /app

RUN pip install prefect==0.10.1 simplejson twarc neo4j boto3==1.12.39 \
Copy link
Copy Markdown
Contributor

@lmeyerov lmeyerov Aug 16, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

guessing we'll also need pandas/twint/bs4
&& ( prefect agent install local > supervisord.conf )
WORKDIR /app
RUN prefect backend server
CMD ["./infra/pipelines/docker/entrypoint.sh"]
CMD ["./infra/pipelines/docker/entrypoint.sh"]