Introducing Tiny BPE TrainerMost modern NLP models today from GPT to RoBERTa, rely on subword tokenization using Byte Pair Encoding (BPE). But what if you want to train your own vocabulary in pure C++? Meet Tiny BPE Trainer - a blazing-fast, header-only BPE trainer written in modern C++17/20, with zero dependencies,...
Programming Tutorials
Practical programming tutorials with clear examples and best practices for Python, C++, JavaScript and more. Learn design, testing and performance.
Introducing Modern Text TokenizerModern natural language processing (NLP) models like BERT, DistilBERT, and other transformer-based architectures rely heavily on effective tokenization. But C++ developers often face limited options like bloated dependencies, poor Unicode support, or lack of compatibility with...
Embarking on a journey into the world of programming can be both exciting and overwhelming. With countless programming languages to choose from, it’s essential to pick the right one that aligns with your goals and aspirations. In this article, we will explore the factors to consider when choosing your first programming...
If you are playing around with .NET and you come from a C/C++ background like myself, you will quickly notice the data types are different. This post covers most common data types from C/C++ to .NET (C#) for your convenience in development. When you search for a data type just hit CTRL + F and the browser will help you...
Sorry for not writing anything interesting this month so far, it’s been a very hectic month. Today I saw a question on Stack Overflow regarding debugging. The user was trying to let Visual Studio run in debug mode with his application to see when and why it crashes. That’s not a solution because there are functions in...
If you are here reading this post, it means you are looking for a way to convert your DOS and/or NT paths for your software. Rest assured that this is what you will learn here today! The problem with Windows paths are clear; it’s so confusing. Let me repeat that, so confusing. This becomes a problem when you are...
Runtime Encrypted StringsToday we will go through the basics of runtime encrypted strings, why do we need to encrypt our strings and learn how to create our own. In this article you will understand and learn: What is runtime encryption and decryption Why do you need to encrypt your strings See how anybody can see your...