Reads every page you list, pulls out the details you asked for with AI, and adds one row per page to your sheet.
Uses
Google Sheets
Jina AI
OpenAI
Turn a list of web pages into spreadsheet rows
Set pageUrls to blank.Set pageUrls to blank.Set fieldsToExtract to blank.Set fieldsToExtract to blank.Set spreadsheetUrl to blank.Set spreadsheetUrl to blank.Set sheetName to Sheet1.Set sheetName to Sheet1.Set maxPageCharacters to 12000.Set maxPageCharacters to 12000.Set columnSeparator to |||.Set columnSeparator to |||.
Split pageUrls by , and save it as pages.Split pageUrls by , and save it as pages.Set rowsWritten to 0.Set rowsWritten to 0.Set pagesWithoutRows to an empty list.Set pagesWithoutRows to an empty list.
For each listedPage in pages:For each listedPage in pages:Trim listedPage and save it as webPage.Trim listedPage and save it as webPage.
If webPage doesn't start with httpIf webPage doesn't start with httpYes
Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.
Show in the output: Skipped '@webPage' - each page in the 'pageUrls' step has to be a full web address starting with http.Show in the output: Skipped '@webPage' - each page in the 'pageUrls' step has to be a full web address starting with http.Skip to the next item.Skip to the next item.No
No steps
If a step below fails, save the error as pageErrorIf a step below fails, save the error as pageErrorTry
Jina AIRead the page at webPage with Jina. Save it as page.Read the page at webPage with Jina. Save it as page.Trim page.content and save it as pageText.Trim page.content and save it as pageText.If pageText isn't emptyIf pageText isn't emptyYes
Set prompt to You are reading one web page and filling in one row of a spreadsheet.Set prompt to You are reading one web page and filling in one row of a spreadsheet.
Pull out these details, in this exact order:
fieldsToExtract
Reply with ONE line and nothing else. Separate the values with columnSeparator in the order listed above. Do not repeat the field names, do not add headings, bullets, numbering or any commentary, and do not wrap values in quotes. Write n/a for anything the page does not say.
Page address: webPage
Page content:
pageText truncated to maxPageCharacters characters.OpenAIAsk OpenAI: prompt. Save it as extraction.Ask OpenAI: prompt. Save it as extraction.Trim extraction.response_text and save it as answerLine.Trim extraction.response_text and save it as answerLine.Create a list of [webPage] and save it as row.Create a list of [webPage] and save it as row.For each extractedValue in answerLine split by columnSeparator:For each extractedValue in answerLine split by columnSeparator: Add extractedValue to the end of row and save it as row. Add extractedValue to the end of row and save it as row.Google SheetsAdd a row to sheetName in spreadsheetUrl.Add a row to sheetName in spreadsheetUrl.
Add 1 to rowsWritten.Add 1 to rowsWritten.No
Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Show in the output: Read '@webPage' but it had no readable text, so no row was written for it.Show in the output: Read '@webPage' but it had no readable text, so no row was written for it.On error
Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Add webPage to the end of pagesWithoutRows and save it as pagesWithoutRows.Show in the output: Could not read '@webPage': pageError as text.Show in the output: Could not read '@webPage': pageError as text.Show in the output: Finished. Wrote rowsWritten as text row(s) to '@sheetName'.Show in the output: Finished. Wrote rowsWritten as text row(s) to '@sheetName'.If pagesWithoutRows isn't emptyIf pagesWithoutRows isn't emptyYes
Show in the output: No row was written for: pagesWithoutRows joined by , .Show in the output: No row was written for: pagesWithoutRows joined by , .No
No steps