| Author(s) | Thu Ya Kyaw |
This guide provides instructions on how to use Vertex AI Studio through the Google Cloud console, without using the API or Python SDK.
Vertex AI Studio is a cloud-based platform that allows users to create and experiment with generative AI models. The platform provides a variety of tools and resources that make it easy to get started with generative AI, even if you don't have a background in machine learning.
There are two ways to access the Language offerings from Vertex AI Studio on Google Cloud:
- Click the OPEN button at the bottom of the Language box on the Vertex AI Studio Overview page.
Upon clicking, the following page will be presented.
Create Prompt lets you designs prompts for tasks relevant to your business use case including code generation. To get started, click on the + TEXT PROMPT button as shown in the image below
Upon clicking, you will be redirected to the following page. You can hover or click on ? buttons to find out more about each field and parameter. Also, the following image has been annotated to provide a quick overview of the interface.
You can feed your desired input text, e.g. a question, to the model. The model will then provide a response based on how you structured your prompt. The process of figuring out and designing the best input text (prompt) to get the desired response back from the model is called Prompt Design.
Currently, there is no best way to design the prompts yet. Generally, there are 3 methods that you can use to shape the model's response in a way that you desired.
- Zero-shot prompting - This is a method where the LLM is given no additional data on the specific task that it is being asked to perform. Instead, it is only given a prompt that describes the task. For example, if you want the LLM to answer a question, you just prompt "what is prompt design?".
- One-shot prompting - This is a method where the LLM is given a single example of the task that it is being asked to perform. For example, if you want the LLM to write a poem, you might give it a single example poem.
- Few-shot prompting - This is a method where the LLM is given a small number of examples of the task that it is being asked to perform. For example, if you want the LLM to write a news article, you might give it few news articles to read.
You may also notice the FREE-FORM and STRUCTURED tabs in the image above. Those are the two modes that you can use while designing your prompt.
- FREE-FORM - This mode provides a free and easy approach to design your prompt. It is suitable for small and experimental prompts with no additional examples. You will be using this to explore zero-shot prompting.
- STRUCTURED - This mode provides an easy-to-use template approach to prompt design. Context and multiple examples can be added to the prompt in this mode. This is especially useful for one-shot and few-shot prompting methods which you will be exploring later.
You will try zero-shot prompting in FREE-FORM mode. To start,
- copy "What is a prompt gallery?" over to the prompt input field
- click on the SUBMIT button on the right side of the page
The model will respond a comprehensive definition of the term prompt gallery.
Here are a few exploratory exercises for you to explore.
- adjust the
Token limitparameter to1and click the SUBMIT button - adjust the
Token limitparameter to1024and click the SUBMIT button - adjust the
Temperatureparameter to0.5and click the SUBMIT button - adjust the
Temperatureparameter to1.0and click the SUBMIT button
Inspect if how the responses change as to change the parameters?
With STRUCTURED mode, you can design prompts in more organized ways. You can also provide Context and Examples in their respective input fields. This is a good opportunity to learn one-shot and few-shot prompting.
In this section, you will ask the model to complete a sentence. Go back to the Text Prompt window and
- click on the STRUCTURED tab if you have not
- copy "the colour of the sky is" in INPUT field
- click on the SUBMIT button on the right side of the page
You would see a similar result as shown in the image below.
Instead of completing the sentence, the model gave a full sentence as a response which is not what we wanted. You can try to influence the model's response with one-shot prompting. This time around you will add an example for the model to based its output from.
Under Examples field,
- copy "the colour of the grass is" to the INPUT field
- copy "green" to the OUTPUT field
- click on the SUBMIT button on the right side of the page.
Now the model will respond to complete the sentence instead. The response should be something similar to this.
Congrats! You have successfully influenced the way the model produces response.
For the next task, you will use the model to perform sentiment analysis on a sentence, such as determining whether a movie review is positive or negative. Go back to the Text Prompt window and
- copy the prompt "It was a time well spent!" over to the INPUT field
- click on the SUBMIT button on the right side of the page
As you can see, the model did not have enough information to know whether you were asking it to do sentiment analysis. This can be improved by providing the model with a few examples of what you are looking for.
Try adding these examples as shown in the image below:
| INPUT | OUTPUT |
|---|---|
| A well-made and entertaining film | positive |
| I fell asleep after 10 minutes | negative |
| The movie was ok | neutral |
and click on the SUBMIT button on the right side of the page
The model will now responds the way you wanted. It should respond as positive.
You can also save the newly designed prompt. To save the prompt, click on SAVE button and name it anyway you like.
The saved prompt will appear at the MY PROMPTS tab.
Go back to the Language page and click on the + TEXT CHAT button to create a new chat prompt.
You will see the new chat prompt page. It's relatively similar to the new prompt page that you went through earlier.
For this section, you will add context to the chat and let the model respond based on the context provided. Let's add these contexts to the Context field.
- copy these context to Context field
Your name is Roy.
You are a support technician for an IT department.
You only respond with "Have you tried turning it off and on again?" to any queries.
- copy "my computer is so slow" to the chat box and
- press Enter key or click the send message button (the right arrow-head button)
The model would consider the provided additional context and answer the questions within the constraints.
Prompt Gallery lets you explore how generative AI models can work for a variety of use cases. There are a variety of topics: Summarization, Classification, Extraction, Writing, and Ideation for you to explore. Head back to the Get Started page and explore them at your own pace.