Data Acquisition Engineer

About the company

COVID-19 has created a new social, political and economic world order – one that is increasingly driven by cultural narratives and online discourse. NWO’s bleeding-edge technology enables clients to surface the fears, motivations and demand drivers underlying various trends, providing them with unprecedented access to the why behind a narrative. NWO’s platform is already in use by Fortune 500 brands to empower strategic business decisions.

Job Description

Following an impressive seed-funding-round in 2020, we are scaling fast and searching for a talented Data Acquisition Engineer that enjoys solving complex data processing problems at scale, exploring and onboarding new data sets, and in particular, web scraping. You’ll spend your time building reliable, scalable web scrapers and data pipelines, geared toward producing the datasets that power our product (at the intersection of NLP, time series forecasting, and trend detection). Data is at the heart of everything we do, and as such, your work will have a massive impact on the future trajectory of the product.

Required Skills

  • Passionate about web scraping and familiar with techniques and tools for crawling, extracting and processing data - e.g. Selenium, BeautifulSoup, Scrapy, etc

  • Experience with Linux/UNIX, HTTP, HTML, Javascript and Networking

  • Expertise in Python & SQL

Experience with at least a couple of the following:

  • Cloud operations and architectures, especially for data-heavy applications - specifically on GCP and with BigQuery

  • Job scheduling & orchestration frameworks - e.g. Jenkins, Luigi, Airflow, message queues etc.

  • Best practices for developing software (version control, CI/CD, automation, peer-programming, documentation, testing, etc.)

Nice to haves

  • Natural language processing (NLP) experience

  • Interest in machine learning, and experience building ML-driven or algorithmic data products

  • A self-starting, intellectually curious, solutions-oriented mindset

Perks

  • Competitive compensation

  • Excellent health, dental and vision benefits

  • Supports working from home

  • Subsidized gym membership

  • Pet-friendly office