██████╗ ███████╗██████╗ ██████╗ ██████╗ ██████╗ ███████╗
██╔══██╗██╔════╝██╔══██╗██╔════╝██╔═══██╗██╔══██╗██╔════╝
██║ ██║█████╗ ██║ ██║██║ ██║ ██║██████╔╝█████╗
██║ ██║██╔══╝ ██║ ██║██║ ██║ ██║██╔══██╗██╔══╝
██████╔╝███████╗██████╔╝╚██████╗╚██████╔╝██║ ██║███████╗ v 0.1.0
DEDCORE
"I'm not saying you have a hoarding problem, but your hard drive called..."
- 🦸 Multi-Algorithm Hashing: SHA-256, Blake3, and xxHash walk into a bar... your files don't stand a chance
- ⚡ Parallel Processing: Because watching paint dry is only fun the first 10,000 times
- 🎯 Smart Filtering: Size, type, age, regex - because not all files are created equal (but some are exactly equal)
- 🛡️ Safe Mode: Quarantine before delete - like a witness protection program for your files
- 📊 Fancy Reports: JSON/HTML reports so detailed they make your cat photos jealous
- 🔍 Text Similarity: Finds files that are suspiciously similar (great for finding that essay you rewrote 14 times)
- 🖼️ Image Dedupe: Because you don't need 37 copies of the same cat picture (or do you?)
- ⏱️ Incremental Scans: Only checks what's changed - like a detective who's good at their job
- ⏮️ Undo Button: Because sometimes you DO need that 14th copy of the cat picture
- 💾 Space Analysis: Shows you exactly how much space you'll save (spoiler: it's never enough)
# Install via cargo (requires Rust toolchain)
cargo install dedcore
# Add to PATH (because typing the full path is so 1990s)
echo 'export PATH="$HOME/.cargo/bin:$PATH"' >> ~/.bashrc # or ~/.zshrc
source ~/.bashrc # or restart your terminal# Build from source (for the truly brave)
git clone https://github.com/manishyoudumb/dedcore.git
cd dedcore
cargo build --release
# The binary is now in ./target/release/dedcoreyay -S dedcore # Coming soon to an AUR near you!Just run dedcore in your terminal and let the beautiful TUI guide you through the process:
dedcore- Main Menu: Choose between scanning for duplicates, managing quarantined files, or getting help
- Interactive Scanning:
- Select directories to scan
- Choose file types to include or exclude
- Set similarity thresholds with easy sliders
- Preview results before taking any action
- Quarantine Management:
- Review and manage quarantined files
- Restore files if you change your mind
- Permanently delete when you're ready
- Use arrow keys to navigate
- Press
Tabto switch between elements Enterselects the highlighted optionEscorqto go back/exit
- 🤖 AI-Powered Dedupe: Because sometimes only AI can understand why you have 37 versions of the same document
- 🌐 Cloud Integration: Because the cloud is just someone else's computer
- 📱 Mobile App: For when you need to dedupe on the go (we don't judge)
- 🎨 Better UI: Because terminal colors are nice, but have you seen gradients?
- 🔮 Predictive Dedupe: Knows what you're going to duplicate before you do
- 🧠 Blockchain Integration: Because why not make deduplication 1000x slower?
- 🤖 Robot Butler: Optional feature that also makes you coffee (batteries not included)
Found a bug? Have a feature request? Want to make fun of our code? We'd love to hear from you!
- Fork it (please be gentle)
- Create your feature branch (
git checkout -b feature/amazing) - Commit your changes (
git commit -am 'Add some amazing feature') - Push to the branch (
git push origin feature/amazing) - Open a Pull Request (and pray to the merge gods)
This project is licensed under the MIT License - see the LICENSE file for details.
Disclaimer: We're not responsible for any existential crises caused by realizing how many duplicate files you actually have.
If you like DedCore, consider giving it a ⭐ on GitHub (or a new hard drive):
Made with ❤️, 🦀, and way too many duplicate files.
-
Minimum similarity threshold (0.0 to 1.0) for grouping text files
- 1.0 = files must be identical
- 0.8 = files must be at least 80% similar
- Lower values will group more files together
-
Supported text file extensions:
.txt,.md,.rs,.py,.js,.ts,.java,.c,.cpp,.h,.hpp,.html,.css,.json,.toml,.yaml,.yml,.xml,.csv,.log
DedCore's TUI makes it easy to find similar images:
- Select "Scan for Duplicates" from the main menu
- Choose the directory containing your images
- Adjust the similarity threshold using the intuitive slider
- Let DedCore do its magic!
Image similarity is calculated using perceptual hashing algorithms that generate fingerprints of images. These fingerprints can be compared to determine how similar two images are, even if they have different sizes, formats, or minor modifications.
MIT License