Technical Lead - Analytics

| Milwaukee, WI +9 more | Remote
Sorry, this job was removed at 10:51 a.m. (CST) on Thursday, August 25, 2022
Find out who's hiring in Milwaukee, WI.
See all Data + Analytics jobs in Milwaukee, WI
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

This is a technical lead role to fulfill Syndigo's growing crawling needs. This role drives the development of cutting-edge data-collecting technology, from thousands of websites, with data crawling software using thousands of bots.
HOW YOU MAKE AN IMPACT
The role will require knowledge of overall scraping architecture of setting up environments, understanding sophisticated crawlers to scrape large volumes of unstructured data from public databases, websites, and social platforms using Python. The role will help ensure the accessibility, aesthetics, performance, and security of the application, and will help lead other team members of the software engineering team to perform integration activities.
HOW WE'LL BE WINNING TOGETHER DAY BY DAY

  • The ideal candidate should have in-depth experience in Python, Selenium, JavaScript, Headless


Chrome, Linux, and AWS, and comfortable working in an agile, test-driven environment and is experienced in continuous-delivery processes.

  • Knowledge of digital advertising operations is nice to have.
  • Applicants must also be excellent problem solvers who know how to detect and evade anti-scraping / bot technologies
  • Connect to public databases to ingest data as well as execute one-off imports of data.
  • Create new data ingestion and processing tooling to eliminate manual processes, inefficient or repetitive work, and address quality issues.
  • Use third-party APIs and web scraping tools to source data at scale.
  • Work with the team to scale and embed techniques and help with data ingestion projects.
  • Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical, and visualization tools
  • Develop and implement standards for clean code that maintain modularity, clarity, and portability.
  • Timely escalation with Product and Engineering leaders in grooming of backlog items
  • Demonstrate a passion for continued learning by staying abreast of new technology and trends.
  • Adhere to SDLC and ensure that it is being followed consistently by the entire team
  • Run the daily stand-ups and perform scrum master responsibilities
  • Work with engineers to identify and rank the tech debt items based on ROI, impact, and risks
  • Ensure tech debt items also follow the same engineering grooming / technical planning


WE SHOULD TALK IF THIS SOUNDS LIKE YOU

  • 7+ years of professional web/software development experience.
  • 5-7 years experience in Python.
  • 3+ years of database experience, JavaScript, and Selenium.
  • Crawlers and web scraping experience
  • Networking: HTTP(s), WebSockets, SSH, TCP/IP, DNS
  • Experience with at least two RDBMS, necessary PostgreSQL or MySQL
  • Experience with at least two queue managers or message brokers
  • Unix: command line, IPC, shell scripting
  • Microservices: scaling, monitoring and support experience
  • Advanced in Docker and docker-compose
  • Experience with at least one container orchestrator
  • Knowledge of Browser-Web Server interaction including DNS, HTTP, SSL, GET vs POST.
  • Command of software engineering principles, frameworks, and technologies.
More Information on Syndigo
Syndigo operates in the Analytics industry. The company is located in Nashville, TN, Houston, TX, Washington , DC, Brookfield, WI, Peoria, IL and Chicago, IL. Syndigo was founded in 1973. It has 1000 total employees. It offers perks and benefits such as Volunteer in local community, Partners with nonprofits, Open door policy, OKR operational model, Team based strategic planning and Open office floor plan. To see all 14 open jobs at Syndigo, click here.
Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Candidate Location Eligibility:
Austin, TX
Boston, MA
Chicago, IL
Colorado, CO
Los Angeles, CA
Nashville, TN
New York City, NY
San Francisco, CA
Seattle, WA

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about SyndigoFind similar jobs