Web Scraping Engineer (Mid-Level) Job at Systems Plus, Inc., Arlington, VA

  • Systems Plus, Inc.
  • Arlington, VA

Job Description

Position supports the development and maintenance of the agency’s web scraping infrastructure. The position is responsible for extracting data from various websites and APIs, ensuring data quality and accuracy, and optimizing the scraping process for efficiency. Duties include:

Daily Responsibilities:

  • Develop and maintain web scraping scripts and tools to extract data from websites and APIs.
  • Collaborate with cross-functional teams to understand data requirements and implement scraping solutions accordingly.
  • Monitor and troubleshoot scraping processes to ensure data quality and accuracy.
  • Optimize scraping scripts for performance and efficiency, considering factors such as speed, scalability, and resource utilization.
  • Stay up-to-date with the latest web scraping techniques, tools, and best practices.
  • Conduct data analysis and validation to ensure the integrity of scraped data.
  • Collaborate with data engineering and data science teams to integrate scraped data into our data pipelines and systems.
  • Document and communicate technical solutions, processes, and best practices to team members.

Required Experience:

  • 3+ years of professional experience in web scraping
  • Python, Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium.
  • Work experience with AI/machine learning techniques for data extraction and classification.
  • Understanding of HTML, CSS, and JavaScript to navigate and interact with websites.
  • Work experience working with APIs and handling different data formats (JSON, XML, etc.).
  • Experience with Google Cloud Platform
  • Familiarity with database systems and SQL for data storage and retrieval.
  • Familiarity with data cleaning and preprocessing techniques to ensure data quality.
  • Strong problem-solving skills and ability to troubleshoot and debug scraping issues.
  • Excellent communication and collaboration skills to work effectively in a team environment.
  • Attention to detail and ability to handle large volumes of data efficiently.

Preferred Experience:

  • Experience with cloud platforms for scalable web scraping infrastructure.
  • Familiarity with data visualization tools and techniques.
  • Understanding of legal and ethical considerations related to web scraping.

Required Degree:

  • BS/BA degree in Computer Science, Information Sciences, or related IT discipline OR Allowable
  • Substitution: Additional ten (10) years of related professional experience can be substituted for a BS/BA degree.

Required Clearance: Must have a current Moderate Risk Public Trust. Secret clearance preferred.

Job Tags

Full time, Work experience placement

Similar Jobs

Jobleads-US

Messaging Trust & Safety Lead — Global Impact Job at Jobleads-US

 ...Google Kirkland, WA role leads ecosystem, trust and safety for Google Messages. You will shape anti-abuse protections, partner with Product and Engineering, and guide cross-functional teams to reduce risk across Googles messaging products at scale. The position emphasizes... 

State of Illinois

ADMINISTRATIVE LAW JUDGE Job at State of Illinois

 ...future with the State of Illinois.Position OverviewThe Illinois Department of Human Services seeks to hire an Administrative Law Judge (Technical Advisor III) to conduct specialized administrative hearings and decide complex appeals involving multiple State and Federal... 

FedEx

Package Handler - Part Time (Warehouse like) Job at FedEx

Job Description IMMEDIATE OPENINGS!\n Come for a job and stay for a career! Federal Express Corporation (FEC) is part of the rapidly growing warehouse and transportation sector that helps keep America, and our economy, moving. Be part of a winning team and workplace...

DHL

Forklift Operator Job at DHL

 ...perform material handling and loading/unloading duties. Position: Forklift Operator Shift: Sun-Thurs 3pm-11pm Pay: $18.10/hour +$1...  ...company match - Tuition reimbursement program - Excellent training and career advancement opportunities Grow your skills. Shape... 

TYG Landscape Architecture

Landscape Architect Job at TYG Landscape Architecture

 ...next career move? We'd love to help. As specialist recruiters in Landscape Architecture, we partner with some of the most respected firms across the United States, helping Landscape Architects take the next step in their careers. When you work with us, you'll...