Google PaLM API
I recently got access to Google Maker Suit. It enabled me to try Google’s LLM capabilities.
However, it is only open to the USA currently. I have been using US VPN to access. The API is also working on machines in the USA or may need a proxy.
Fortunately, after getting API keys. I can just use Google Colab to try.
Pros:
- UI
- Google’s UI is better than its competitor
- You can:
- Save to Drive
- Export to ColabEasy few-shot training using example prompts and answers
- Data Prompt option to use structured data
- Easily adjust safety settings
- API
- PaLM 2
- Firebase extensions: Easily implement in a current Firebase project
- Input token limit 8096
- 30 free API calls per minute (3 in ChatGPT)
- PaLM Colab Magic: Enables to work with tabular data easily. Google Sheets support
Cons:
- Output token limit 1024
- I think currently is worse than GPT 4 even 3.5 in many tasks
- They say the knowledge cutoff date is mid-2021. However, it knows something about current news but not much.