Skip to content

0x414854/Wallet_Fetcher

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Static Badge Static Badge Static Badge

Wallet Fetcher

A Python-based tool to automate the fetching, processing, and categorization of cryptocurrency wallet addresses from online sources (Blockchair).
This tool downloads data, decompresses it, and organizes it into specific categories for further analysis or usage.

📚 Table of Contents

📜 Project Description

Wallet Fetcher (WF) is designed to retrieve large datasets of Bitcoin wallet addresses from specified online sources (Blockchair). It automates downloading, decompressing, and categorizing these addresses into meaningful groupings such as balances, prefix types, and subsets for quick reference or downstream processing.

🧮 What is Wallet Fetcher ?

Wallet Fetcher is a Python script that :

  1. Automates file downloads from websites using Selenium.
  2. Decompresses .gz files to extract datasets.
  3. Processes Bitcoin wallet addresses and organizes them based on prefixes (1, 3, or bc1) and balance criteria.
  4. Processes Bitcoin Cash wallet addresses and organizes them based on prefixes (q, p, or other) and balance criteria.
  5. Outputs the processed data into structured text files for easier consumption.

✨ Features

  • Automated File Handling : Automatically fetch and decompress files.
  • Categorization : Splits wallet data into categories based on prefix types and balance ranges.
  • Scheduling : Includes a daily scheduled task to run the entire pipeline at a specified time.
  • Logging : Provides detailed logs for every step of the process.
  • Cryptocurrency Supported : BTC, BCH

🛠️ Prerequisites

  • Python 3.11+
  • Google Chrome installed
  • ChromeDriver compatible with your Chrome version
  • Environment variables configured in a .env file (see Installation)
  • Required Python libraries (see Installation)
    • python-dotenv
    • shadePy
    • selenium
    • tqdm

⚙️ Installation

  1. Clone this repository

    git clone https://github.com/0x414854/Bitcoin_Wallet_Fetcher.git
    cd Bitcoin_Wallet_Fetcher
    
  2. Run the following command to install libraries

    pip install -r requirements.txt
  3. Create a .env file with the following structure :

    DOWNLOAD_FOLDER = Path/To/Download/Folder
    BTC_PROCESSED_FOLDER = Your/Processed/BTC/Folder/Path
    BCH_PROCESSED_FOLDER = Your/Processed/BCH/Folder/Path
    
    LOG_FILE = './logs/wf.log'
    
    BTC_WEBSITE_URL = 'https://gz.blockchair.com/bitcoin/addresses/'
    BCH_WEBSITE_URL = 'https://gz.blockchair.com/bitcoin-cash/addresses/'
    
    BTC_BASE_FILENAME = 'blockchair_bitcoin_addresses_latest'
    BCH_BASE_FILENAME = 'blockchair_bitcoin-cash_addresses_latest'
    
    XPATH_FILE = '/html/body/pre/a[2]'
  4. You're ready to run the program !

    python3 bitcoinWalletFetcher.py

🛣️ Roadmap

  • 💾 Enable sharing of raw and processed files
  • 🪙 Add support for other cryptocurrencies
    • BCH
    • DOGE
    • EGLD
    • ETH
    • LTC
    • SOL
    • XRP
    • ZCASH
  • 🔧 Add Cryptocurrency Selection via Command Line Arguments
  • 🎓 Implement multilingual support
    • French
    • Italian
    • Spanich
    • Portuguese
  • ✅ 🛡️ Add random User-Agent to bypass bot detection restrictions

🌳 Tree Directory

.
├── (.env)
├── .gitignore
├── LICENSE
├── README.md
├── requirements.txt
├── walletFetcher.py
├── 📁 docs/
└── 📁 (logs/)
    └── wf.log

🤝 Contributions

Contributions are welcome ! Feel free to open issues or submit pull requests.

💖 Support the Project

Giving it a star on GitHub ⭐

Your support makes a huge difference ! This project is maintained with the energy, time, and passion of its contributors.
If you enjoy this project or want to help sustain its development, consider making a donation.

Why Donate ? 🫶

  • Help cover development and hardware costs.
  • Contribute to new features and improvements.
  • Support an open-source project to keep it free and accessible to everyone.

Cryptocurrency Wallets 🪙

You can donate using the following cryptocurrency addresses:

  • Bitcoin (BTC) : bc1q6n3ufauzjqgxztkklj3734cp0f7evqq3djh4ne
  • Ethereum (ETH) : 0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
  • Bittensor (TAO) : 5CrG7bKratZVocnxj66FF23AMVvqKHf7RSHfz49csEtJ2CuG
  • Dogecoin (DOGE) : DJQnasX39Unat3vkmyBMgp4H6Kfd4wFumF
  • Solana (SOL) : Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15

USDT (Tether)

  • Binance Smart Chain (BEP-20) : 0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
  • Ethereum (ERC-20) : 0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
  • Tron (TRC-20) : THHcEQ8zG3ZnUXoHdBmCdpZ3AAqhoDbMpW
  • Solana (SPL) : Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15

USDC (USD Coin)

  • Binance Smart Chain (BEP-20): 0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
  • Ethereum (ERC-20): 0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
  • Solana (SPL): Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15

💬 A Big Thank You

Thank you so much for your generosity. Your support truly means the world to us and motivates us to keep improving this project. 🙏

➡️ Take action now ! Every contribution, big or small, makes a huge impact.

📄 License

This project is licensed under the MIT License.

👤 Author

0x414854

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages