• 4am@lemmy.zip
    link
    fedilink
    arrow-up
    8
    ·
    5 days ago

    As you converse with it and it responds, part of the input is just your entire conversation up to that point, and its responses, plus your new prompt. That’s it that’s how the memory works.

    And for this you pay an increasing amount for tokens.

    Michael Reeves did an interesting piece on it: https://youtube.com/shorts/WP5_XJY_P0Q