Why does changing the number of heads not change the number of parameters in the model? – In this post i want to present a short visual example of how changing attention heads impact the model architecture.

If you initialized a Trainer object, it will do the training boiler plate for you. Using the TrainingArguments, you can additionally customize your training process. One important argument is the evaluation_strategy which is set to “no” by default, thus no…

The Tokenizer and PreTrainedTokenizer classes perform different roles. The Tokenizer is a pipeline and defines the actual tokenization, while the PreTrainedTokenizer is more of a wrapper to provide additional functionality to be utilized by other components of the 🤗 Transformer…

Recently i participated in a hackerthon, in which the goal was to create a near real time monitoring dashboard using Microsoft PowerBI. The data was already generated and persisted in SQLServer and needed to be queried efficiently. Since i am…

The other day we had a moderate complex query which involved around 270000 rows but run for over an hour. After updating the statistics the query finished in only 4 seconds.

Sometimes when editing a post or a page in WordPress, the site just crashes with the error “The editor has encountered an unexpected error.” Let’s take a deeper look and try to fix this problem.

A deployed pod is stuck in pending status. Looking deeper into the pod a warning appears: 0/3 nodes are available: 3 node(s) had no available volume zone.

We observed a problem where dags did not run at the specified time at all but consistently started at a random time. Let’s dig into it.

I just stumbled upon probably one of my best documentation snippets on how to move objects between OCI buckets.