Scaling models

1. Goals of this lab

The goal of this lab is to learn how to securely and automatically scale AI models and apps across clusters - more detail needed.

2. Run podman desktop

Introduction to gen AI + discover and experiment with gen AI models and AI applications on the local desktop, in an inner loop

3. TBD

3.1. TBD

4. Start a playground, chat with it

5. Kill playground, try text summarization recipe, upload claim PDF, view summarization

6. Open summarization app (python) in vscode, inspect code (briefly)

7. Change the prompt, restart, and observe changes.

8. Conclusion

We hope you have enjoyed this module!

Here is a quick summary of what we have learned:

  • TBD

  • TBD

  • TBD