Büyük Dil Modelleri Uygulamalı Olarak Nasıl Finetune Yapılır?

Finetune’un nasıl yapıldığını kod üzerinde inceleyeceğiz. Kullanılan yaklaşımları, sınıf ve metodları ve onların parametrelerini inceleyeceğiz.

Erişim İçin: https://cbarkinozer.medium.com/b%C3%BCy%C3%BCk-dil-modelleri-uygulamal%C4%B1-olarak-nas%C4%B1l-finetune-yap%C4%B1l%C4%B1r-a6236cc85a98?source=friends_link&sk=bb9c5ecb3e6e3218ebf339a2245fe16e

Hangi kütüphaneleri ne için kullandığımızı inceleyelim:

# Pandas is a powerful data manipulation and analysis library for Python.
# It provides data structures like DataFrames for efficient data manipulation with built-in functions for data cleaning, exploration, and transformation.
import pandas as pd

# NumPy is a library for numerical operations in Python.
# It provides support for large, multi-dimensional arrays and matrices, along with mathematical functions to operate on these arrays.
import numpy as np

# Matplotlib is a 2D plotting library for Python.
# pyplot is a module in Matplotlib that provides a convenient interface for creating plots and visualizations.
import matplotlib.pyplot as plt

# Seaborn is a statistical data visualization library based on Matplotlib.
# It provides a high-level interface for drawing attractive and informative statistical graphics.
import seaborn as sns

# JSON (JavaScript Object Notation) is a lightweight data interchange format.
# The json library in Python provides methods for encoding and decoding JSON data.
import json

# The os module provides a way of using operating…