-
Transformers, BERT, and GPT (Chapter 3)
I’m reading a book recently called Transformer, BERT, and GPT: Including ChatGPT and Prompt Engineering by Oswald Campesato (2024). The book is divided into 10 Chapters. Here is a summary of the third chapter (Transformer Architecture). Sequence-to-sequence models and “encoder-decoder” are related. The Seq2Seq model consists of two multilayer LSTM (long-term short-term memory): one maps…
-
Transformers, BERT, and GPT (Chapter 2)
I’m reading a book recently called Transformer, BERT, and GPT: Including ChatGPT and Prompt Engineering by Oswald Campesato (2024). The book is divided into 10 Chapters. Here is a summary of the second chapter (Tokenization).
-
Transformers, BERT, and GPT (Chapter 1)
I’m reading a book recently called Transformer, BERT, and GPT: Including ChatGPT and Prompt Engineering by Oswald Campesato (2024). The book is divided into 10 Chapters. Here is a summary of the first chapter (Introduction). Generative AI is a subset of artificial intelligence models designed to generate new data samples similar in nature to the…
-
Some Python interview questions (Part II)
In Part I we talked about three technical interview questions I encountered as a data scientist. We answered the first question, now let’s talk about what a decorator is (we can use function and class interchangeably). According to ChatGPT: A decorator allows you to modify the behavior of a function or a class. It is…
-
Some Python interview questions (Part I)
Python is essential for data science, but a lot of Python is not required to be a successful data scientist. However, the unfortunate situation is that most employers test you on a high level of Python. I recommend reviewing an introduction course on Python with some additional review of how pandas integrates with the workflow.…