AI TOOLKIT
Get started
Recipes/Node.js

Stream Text

Learn how to stream text using the AI TOOLKIT and Node

2 min readnodestreamingView source

Text generation can sometimes take a long time to complete, especially when you're generating a couple of paragraphs. In such cases, it is useful to stream the text to the client in real-time. This allows the client to display the generated text as it is being generated, rather than have users wait for it to complete before displaying the result. Introducing "Joyful Hearts Day" - a holiday dedicated to spreading love, joy, and kindness to others. On Joyful Hearts Day, people exchange handmade cards, gifts, and acts of kindness to show appreciation and love for their friends, family, and community members. It is a day to focus on positivity and gratitude, spreading happiness and warmth to those around us. Traditions include decorating homes and public spaces with hearts and bright colors, hosting community events such as charity drives, volunteer projects, and festive gatherings. People also participate in random acts of kindness, such as paying for someone's coffee, leaving encouraging notes for strangers, or simply offering a helping hand to those in need. One of the main traditions of Joyful Hearts Day is the "Heart Exchange" where people write heartfelt messages to loved ones and exchange them in person or through mail. These messages can be words of encouragement, expressions of gratitude, or simply a reminder of how much they are loved. Overall, Joyful Hearts Day is a day to celebrate love, kindness, and positivity, and to spread joy and happiness to all those around us. It is a reminder to appreciate the people in our lives and to make the world a brighter and more loving place.

txt
  1. 1Introducing "Joyful Hearts Day" - a holiday dedicated to spreading love, joy, and kindness to others.
  2. 2On Joyful Hearts Day, people exchange handmade cards, gifts, and acts of kindness to show appreciation and love for their friends, family, and community members. It is a day to focus on positivity and gratitude, spreading happiness and warmth to those around us.
  3. 3Traditions include decorating homes and public spaces with hearts and bright colors, hosting community events such as charity drives, volunteer projects, and festive gatherings. People also participate in random acts of kindness, such as paying for someone's coffee, leaving encouraging notes for strangers, or simply offering a helping hand to those in need.
  4. 4One of the main traditions of Joyful Hearts Day is the "Heart Exchange" where people write heartfelt messages to loved ones and exchange them in person or through mail. These messages can be words of encouragement, expressions of gratitude, or simply a reminder of how much they are loved.
  5. 5Overall, Joyful Hearts Day is a day to celebrate love, kindness, and positivity, and to spread joy and happiness to all those around us. It is a reminder to appreciate the people in our lives and to make the world a brighter and more loving place.

Run it locally

$ npm install ai

Without reader

import { streamText } from 'ai-toolkit';

const result = streamText({

model: 'openai/gpt-4o',

maxOutputTokens: 512,

prompt: 'Invent a new holiday and describe its traditions.',

});

for await (const textPart of result.textStream) {

console.log(textPart);

}

index.ts
ts
  1. 1import { streamText } from 'ai-toolkit';
  2. 2const result = streamText({
  3. 3 model: 'openai/gpt-4o',
  4. 4 maxOutputTokens: 512,
  5. 5 prompt: 'Invent a new holiday and describe its traditions.',
  6. 6});
  7. 7for await (const textPart of result.textStream) {
  8. 8 console.log(textPart);
  9. 9}

With reader

import { streamText } from 'ai-toolkit';

const result = streamText({

model: 'openai/gpt-4o',

maxOutputTokens: 512,

prompt: 'Invent a new holiday and describe its traditions.',

});

const reader = result.textStream.getReader();

while (true) {

const { done, value } = await reader.read();

if (done) {

break;

}

process.stdout.write(value);

}

index.ts
ts
  1. 1import { streamText } from 'ai-toolkit';
  2. 2const result = streamText({
  3. 3 model: 'openai/gpt-4o',
  4. 4 maxOutputTokens: 512,
  5. 5 prompt: 'Invent a new holiday and describe its traditions.',
  6. 6});
  7. 7const reader = result.textStream.getReader();
  8. 8while (true) {
  9. 9 const { done, value } = await reader.read();
  10. 10 if (done) {
  11. 11 break;
  12. 12 }
  13. 13 process.stdout.write(value);
  14. 14}
Browse all recipes