A Python-based tool to automate the fetching, processing, and categorization of cryptocurrency wallet addresses from online sources (Blockchair).
This tool downloads data, decompresses it, and organizes it into specific categories for further analysis or usage.
- 📜Project Description
- 📚 Table of Contents
- 🧮 What is Wallet Fetcher?
- ✨ Features
- 🛠️ Prerequisites
- ⚙️ Installation
- 🛣️ Roadmap
- 🌳 Tree Directory
- 🤝 Contributions
- 💖 Support the Project
- 📄 License
- 👤 Author
Wallet Fetcher (WF) is designed to retrieve large datasets of Bitcoin wallet addresses from specified online sources (Blockchair). It automates downloading, decompressing, and categorizing these addresses into meaningful groupings such as balances, prefix types, and subsets for quick reference or downstream processing.
Wallet Fetcher is a Python script that :
- Automates file downloads from websites using
Selenium
. - Decompresses
.gz
files to extract datasets. - Processes Bitcoin wallet addresses and organizes them based on prefixes (
1
,3
, orbc1
) andbalance
criteria. - Processes Bitcoin Cash wallet addresses and organizes them based on prefixes (
q
,p
, orother
) andbalance
criteria. - Outputs the processed data into structured text files for easier consumption.
- Automated File Handling : Automatically fetch and decompress files.
- Categorization : Splits wallet data into categories based on prefix types and balance ranges.
- Scheduling : Includes a daily scheduled task to run the entire pipeline at a specified time.
- Logging : Provides detailed logs for every step of the process.
- Cryptocurrency Supported :
BTC
,BCH
Python 3.11+
Google Chrome
installedChromeDriver
compatible with your Chrome version- Environment variables configured in a
.env
file (see Installation) - Required Python libraries (see Installation)
python-dotenv
shadePy
selenium
tqdm
-
Clone this repository
git clone https://github.com/0x414854/Bitcoin_Wallet_Fetcher.git
cd Bitcoin_Wallet_Fetcher
-
Run the following command to install libraries
pip install -r requirements.txt
-
Create a
.env
file with the following structure :DOWNLOAD_FOLDER = Path/To/Download/Folder BTC_PROCESSED_FOLDER = Your/Processed/BTC/Folder/Path BCH_PROCESSED_FOLDER = Your/Processed/BCH/Folder/Path LOG_FILE = './logs/wf.log' BTC_WEBSITE_URL = 'https://gz.blockchair.com/bitcoin/addresses/' BCH_WEBSITE_URL = 'https://gz.blockchair.com/bitcoin-cash/addresses/' BTC_BASE_FILENAME = 'blockchair_bitcoin_addresses_latest' BCH_BASE_FILENAME = 'blockchair_bitcoin-cash_addresses_latest' XPATH_FILE = '/html/body/pre/a[2]'
-
You're ready to run the program !
python3 bitcoinWalletFetcher.py
- 💾 Enable sharing of raw and processed files
- 🪙 Add support for other cryptocurrencies
- ✅ BCH
- DOGE
- EGLD
- ETH
- LTC
- SOL
- XRP
- ZCASH
- 🔧 Add Cryptocurrency Selection via Command Line Arguments
- 🎓 Implement multilingual support
- French
- Italian
- Spanich
- Portuguese
- ✅ 🛡️ Add random User-Agent to bypass bot detection restrictions
.
├── (.env)
├── .gitignore
├── LICENSE
├── README.md
├── requirements.txt
├── walletFetcher.py
├── 📁 docs/
└── 📁 (logs/)
└── wf.log
Contributions are welcome ! Feel free to open issues or submit pull requests.
Giving it a star on GitHub ⭐
Your support makes a huge difference ! This project is maintained with the energy, time, and passion of its contributors.
If you enjoy this project or want to help sustain its development, consider making a donation.
- Help cover development and hardware costs.
- Contribute to new features and improvements.
- Support an open-source project to keep it free and accessible to everyone.
You can donate using the following cryptocurrency addresses:
- Bitcoin (BTC) :
bc1q6n3ufauzjqgxztkklj3734cp0f7evqq3djh4ne
- Ethereum (ETH) :
0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
- Bittensor (TAO) :
5CrG7bKratZVocnxj66FF23AMVvqKHf7RSHfz49csEtJ2CuG
- Dogecoin (DOGE) :
DJQnasX39Unat3vkmyBMgp4H6Kfd4wFumF
- Solana (SOL) :
Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15
- Binance Smart Chain (BEP-20) :
0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
- Ethereum (ERC-20) :
0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
- Tron (TRC-20) :
THHcEQ8zG3ZnUXoHdBmCdpZ3AAqhoDbMpW
- Solana (SPL) :
Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15
- Binance Smart Chain (BEP-20):
0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
- Ethereum (ERC-20):
0x24800123e8D51F1d596c6Abe4B5DB5A10837Fe8e
- Solana (SPL):
Gj9JkpFqdSabag8RiiNTmLaCiZrcxYa6pc4y599vft15
Thank you so much for your generosity. Your support truly means the world to us and motivates us to keep improving this project. 🙏
➡️ Take action now ! Every contribution, big or small, makes a huge impact.
This project is licensed under the MIT License.