Add postgres data via drizzle

wiesson9 months ago

10

await db.insert(users).values([{ name: 'Andrew' }, { name: 'Dan' }]);

• 

  denolfe

  9 months ago

  It looks like we may be missing some type inference, but you should be able to access the table by passing

  payload.db.tables['media'])
• 

  wiesson9 months ago

  Yes! That was the missing part!

  
  
  

  const chunkArray = (array, chunkSize) => {
    const chunks = [];
    for (let i = 0; i < array.length; i += chunkSize) {
      chunks.push(array.slice(i, i + chunkSize));
    }
    return chunks;
  };
  
  const doAction = async () => {
    await payload.init({
      secret: PAYLOAD_SECRET,
      local: true,
    });
  
    const toImport = images.map((image) => ({
      createdAt: image.created_at,
      updatedAt: image.updated_at || image.created_at,
      alt: image.alt || "",
      caption: image.caption || "",
      url: image.url || "",
      filename: image.image || "",
      mime_type: image.type || "",
    }));
  
    const chunks = chunkArray(toImport, 500);
  
    for (const chunk of chunks) {
      await payload.db.drizzle.insert(payload.db.tables["media"]).values(chunk);
    }
  };
  
  doAction();

• 

  denolfe

  9 months ago

  @wiesson Amazing 🙌

• 

  wiesson9 months ago

  If I have time, I could do a PR with extended documentation how to import data

• 

  denolfe

  9 months ago

  That would be much appreciated 👍 Probably in this area of the docs

  https://github.com/payloadcms/payload/blob/main/docs/database/postgres.mdx#L46
• 

  wiesson9 months ago

  I'm basically replacing my old Django app with Payload and I have exportet all data as JSON and I'm now writing migration scripts to add the data to the DB

• 

  denolfe

  9 months ago

  Wow, sounds like a good amount of work. Looks like you're well on your way, though.

• 

  wiesson9 months ago

  btw, I wanted to use

  await payload.create({ collection: "media", data: { ... data here ... } })
  

  but I don't want to upload the file, because it's already stored inside the CDN

• 

  denolfe

  9 months ago

  Hmm, yeah that's tricky.

  
  

  
  

  Could do an

  update

  after the fact, but on creation I believe you need to pass the asset

• 

  wiesson9 months ago

  One question - I'm using the

  url

  field as my CDN url. But it gets overwritten somehow when I try to display the thumbnailImage

  
  

  
  

  I assume that payload tries to create the URL for me (based on my static url + filename?)

  
  

  
  

  Besides that, 18532 images imported ✅ 🙂