Skip to content

fix: update requirements.txt with missing dependencies and fix installation errors - #9

Open
devsanthoshmk wants to merge 1 commit into
christivn:mainfrom
devsanthoshmk:main
Open

fix: update requirements.txt with missing dependencies and fix installation errors#9
devsanthoshmk wants to merge 1 commit into
christivn:mainfrom
devsanthoshmk:main

Conversation

@devsanthoshmk

Copy link
Copy Markdown
Contributor

Summary of Changes

This PR resolves installation errors and missing runtime dependencies in requirements.txt:

  1. Remove obsolete package json-lib==0.5.1:

    • json-lib is an unmaintained C extension that fails to build/install on modern Python versions (e.g. 3.10+). Python's standard library json is used instead.
  2. Add missing dependencies used in main.py pipeline:

    • pandas>=2.0.0: Required by pipeline/orchestrator.py for pipeline dataframe operations.
    • beautifulsoup4>=4.12.0: Required by enrichment/web_scraper.py for lead website parsing.
  3. Add brotli>=1.1.0:

    • mapScraper/placesCrawlerV2.py sends Accept-Encoding: gzip, deflate, br. Without brotli, aiohttp raises 400 Can not decode content-encoding: brotli (br).
  4. Clean up standard library and redundant packages:

    • Removed argparse==1.4.0 and asyncio as they are built into standard library Python.
    • Relaxed overly rigid version pins to support modern Python (3.10 through 3.14).

Verification

  • Tested clean installation in a fresh Python virtual environment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant