It is well known that running LLMs locally requires downloading models (which are large) and is hardware intensive. Recently, GitHub launched the GitHub Models service, which allows developers to run LLMs locally on GitHub.Free Test Llama, Phi 3, Mistral and GPT-4o, among other big models. However, the service is still in public beta, similar to the early Copilot, and is not fully open. You need to submit an application (waitlist) and wait for approval before you can use it.
While I haven't qualified for the public beta yet, eyeballing the service, it should offer a certain amount of free online experiences with LLMs per day (Playground), and then add in cloud development Codespaces and Azure services for a fee. My main concern, like everyone else's, is whether the free ones are fun to use!
Getting back to this week's open source hot project, since it's not completely free to use, try running the LLMs chat app on your phone with torchchat for anytime, anywhere, unlimited chatting with LLMs. There's also seek-tune, a Shazam-like song recognition service that makes it easy to discover and download songs with familiar tunes. Buster, a browser plugin that breaks reCAPTCHA CAPTCHAs based on voice recognition technology, beats technology with technology.
Finally, with a lightweight LDAP service implemented in Rust and a tool to visually compare two PDF files, experience the efficiency and convenience of a minimalist application.
- Table of Contents for this article
- 1. Open-source journalism
- 1.1 GitHub Models Online Free Test LLMs
- 2. Open source hot search project
- 2.1 The Python library for chatting with LLMs anywhere, anytime: torchchat
- 2.2 Open Source Malicious Traffic Detection Platform: Maltrail
- 2.3 Browser plugin to crack reCAPTCHA: buster
- 2.4 Lightweight LDAP Implementation: lldap
- 2.5 Shazam-like song recognition algorithm: seek-tune
- 3. HelloGitHub Hot Reviews
- 3.1 Tools to visually compare two PDF files: diff-pdf
- 3.2 Tools for Running iOS Games and Apps on a Mac: PlayCover
- 4. Conclusion
- 1. Open-source journalism
1. Open-source journalism
1.1 GitHub Models Online Free Test LLMs
GitHub Models provides a chat application service (Playground) for experiencing large language models (LLMs) online, where users can experience, test, and run LLMs online, and it also integrates Codespaces with the ability to run and develop LLMs in the cloud, which lowers the threshold for large model development. Currently, it only supports large models such as Llama, Phi 3, Mistral and GPT-4o, and does not support the uploading of customized models for the time being.
2. Open source hot search project
2.1 The Python library for chatting with LLMs anywhere, anytime: torchchat
Main language: Python，Star：2.4k，Weekly growth: 2k
This project is an open source Python library from the PyTorch team designed to simplify running Large Language Models (LLMs), making it easy to run LLMs chat apps on desktops, servers, iOS, and Android. Users can interact with large models directly from the command line or launch the WebUI to use them in a browser. In addition, based on PTE files generated by ExecuTorch, it is also possible to generate LLMs chat apps for mobile devices, with support for macromodels such as Llama 3.1, Llama 3, and Mistral.
GitHub address →/pytorch/torchchat
2.2 Open Source Malicious Traffic Detection Platform: Maltrail
Main language: Python，Star：6.1k，Weekly growth: 100
This is a malicious traffic detection system developed in Python for identifying and tracking suspicious web requests. It uses publicly available blacklists and customized lists for real-time traffic monitoring and provides a simple web interface for presenting reports and analysis results, support for detecting suspicious information such as domain names, URLs, IPs, or HTTP User-Agents, as well as heuristic analysis capabilities for discovering new or unknown threats.
GitHub address →/stamparm/maltrail
2.3 Browser plugin to crack reCAPTCHA: buster
Main language: JavaScript，Star：7.4k，Weekly growth: 200
This project utilizes language recognition technology to help users automate reCAPTCHA CAPTCHA-authenticated browser plug-ins for Chrome, Edge, and Firefox browsers.
GitHub address →/dessant/buster
2.4 Lightweight LDAP Implementation: lldap
Main language: Rust，Star：4k，Weekly growth: 100
This project implements a lightweight LDAP (Lightweight Directory Access Protocol) service in Rust to simplify user authentication and management. It has a simple configuration , less resource consumption , friendly web interface , etc., supports reset password and Docker deployment , the default use of SQLite database , but also compatible with MySQL and PostgreSQL and other databases .
GitHub address →/lldap/lldap
2.5 Shazam-like song recognition algorithm: seek-tune
Main language: Go，Star：1.3k，Weekly growth: 1.1k
This project implements a Shazam-like song recognition algorithm in Go and provides an easy-to-use web service. It utilizes audio fingerprinting to recognize the music a user is playing, and integrates with Spotify and YouTube to discover and download music with a single click.
GitHub address →/cgzirim/seek-tune
3. HelloGitHub Hot Reviews
In this section, we'll share this week's top open source projects on the HelloGitHub website, and you're welcome to share your experiences with these open source projects once you get your hands on them.
3.1 Tools to visually compare two PDF files: diff-pdf
Main language: C++
This is a PDF file comparison tool written in C++. It supports two ways of viewing, either by exporting the differences in file contents to a new PDF file, or by viewing them directly in the GUI.
Project Details→/repository/398f817f245e404b8ae7ad8ab7e80420
3.2 Tools for Running iOS Games and Apps on a Mac: PlayCover
Main language: Swift
This program is a tool designed for Apple Silicon Mac devices (M-series chips) to run iOS apps and games. It allows users to play iOS games on Mac computers by emulating the iPad environment and keyboard mapping features. It requires the download of an IPA file by itself and is available for macOS 12.0 or later.
Project Details→/repository/2bb52cdd3e5b42df9cb171a00f66863a
4. Conclusion
Above is the whole content of this issue of "GitHub Hot Spot", I hope you can find the open source projects you are interested in here, if you have other fun, interesting GitHub open source projects you want to share, welcome to theHelloGitHub Share and discuss with us.
Past Review
- Browser plugins that optimize the GitHub experience
- NVIDIA takes another step toward open source