Software Engineer (Data Acquisition)

We are seeking a dedicated and passionate software engine to join our team. This role will support development, innovation, and maintenance of our data acquisition pipeline.

Apply for this position
New York City or Remote
Full Time

About Daash Intelligence:

Daash Intelligence is a well-funded tech start-up at the forefront of next-gen predictive commerce intelligence. Our mission is to make retail markets more transparent, enabling customers to track and predict market trends more easily, thoroughly, and affordably. This is crucial because countless small and mid-sized consumer brands struggle to compete with larger companies that invest millions in market research. Daash tackles this by democratizing access to the actionable intelligence these brands need to thrive.

Our rapidly growing team of dedicated scientists, engineers, and business leaders is united in this vision, and the market response has been incredible! While in stealth mode, we quickly secured over 40 high-profile clients using our platform for their business decisions. Join us and contribute to our collaborative and innovative team as we revolutionize the commerce intelligence industry!

Position Overview:

We are looking for a talented and driven Software Engineer to join our "Data Acquisition" team, which is responsible for acquiring public data using large-scale web crawlers. Most of Daash’s research and products are built on ML and AI models, which depend on high-quality data used for model training and powerful analytics. Successfully expanding our data corpus is vital to this effort.

At Daash we work as a single cohesive team on just a few large-scale projects. We are an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-value work at any given time. As such, we greatly value a high level of communication skills and awareness of broader company goals and objectives.

Responsibilities:

As a member of the Data Acquisition Team, your responsibilities will include:

  • Develop and maintain large-scale web crawlers
  • Help improve the observability, maintainability and debuggability of the overall crawler system
  • Collaborate with team members on improving data acquisition processes
  • Participate in code reviews and debugging sessions
  • Participate in strategy and analysis for new data acquisition targets 
  • Complete analyses scraper data output for accuracy evaluation

Minimum Qualifications:

  • Advanced/fluent in Python (OOP concepts like multiple inheritance) 
  • Proficient in at least on web scraping framework (Scrapy, preferred)
  • Proficient in using Python pandas for data analysis
  • A foundational knowledge of how modern websites work: client-side vs server-side sites; static vs dynamic HTML; APIs; headers; user-agents; cookies; token authentication; using the browser console. 
  • Experience with Jupyter notebooks
  • Experience with Github for source control

Preferred Qualifications:

  • Proficiency in SQL
  • Experienced with navigating blocks or maintaining web scrapers
  • Experienced with AWS (S3, Athena, Cloudwatch)
  • Have developed with GraphQL or a front-end framework
  • Have a strong grasp of event-driven/asynchronous programming
  • Have worked in the e-commerce or retail industries
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • 1-2 years of experience in data engineering or a related field

Benefits:

  • Base Salary: $100,000 - $130,000 (depending on experience and qualifications)
  • Performance-Based Bonus: Eligible for an annual bonus based on individual and company performance
  • Equity: Opportunity to participate in the company’s equity program, with grants awarded based on performance and role level
  • Comprehensive Health, Dental and Vision insurance plan coverage
  • Unlimited PTO policy
  • Hybrid office/home environment with flexible scheduling (though the company operates on Eastern Standard Time)

Equality Opportunity Statement

Daash Intelligence, Inc is an equal opportunity employer. We value diversity and do not discriminate on the basis of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are committed to creating an inclusive and supportive work environment where every individual feels valued and empowered.


Candidates passionate about contributing to the future of predictive commerce intelligence are encouraged to submit their resume to hiring@daash.co.