From 5d1f85019649d03aae898fbd525f0d22038b4a74 Mon Sep 17 00:00:00 2001 From: "Alessandro de Oliveira Faria (A.K.A. CABELO)" Date: Tue, 14 Jan 2025 04:59:04 -0300 Subject: [PATCH] OpenVINO 2024.6.0 --- _posts/2025/2025-01-14-openvino-202460.md | 51 +++++++++++++++++++++++ 1 file changed, 51 insertions(+) create mode 100644 _posts/2025/2025-01-14-openvino-202460.md diff --git a/_posts/2025/2025-01-14-openvino-202460.md b/_posts/2025/2025-01-14-openvino-202460.md new file mode 100644 index 00000000..a715773c --- /dev/null +++ b/_posts/2025/2025-01-14-openvino-202460.md @@ -0,0 +1,51 @@ +--- +author: Alessandro de Oliveira Faria +date: 2024-05-14 05:30:00 +layout: post +license: CC-BY-SA-3.0 +title: OpenVINO with Generative AI +image: /wp-content/uploads/2024/05/openvino.png +categories: +- openSUSE +- Announcements +- Tumbleweed +tags: +- openSUSE +- Innovators +- OpenCV +- OpenVINO +- GPU +- VPU +- NPU +- Artificial Intelligence +- Machine Learning community + +--- + +As always focused on the [openSUSE Innovator initiative](https://en.opensuse.org/openSUSE:INNOVATORS) and as an openSUSE and [Intel Innovator](https://www.intel.com/content/www/us/en/developer/articles/community/experts-de-oliveira-faria.html) member, I continue to strive to help keep the [openVINO](https://software.opensuse.org/package/openvino) repository up to date with the openSUSE Linux distribution community. + +OpenVINO (Open Visual Inference and Neural Network Optimization) is one of the most crucial tools in the AI ecosystem, especially for applications requiring optimized performance for deep learning model inference. The 2024.6.0 release brings significant advancements in compatibility, optimizations, and support for complex models, including those used in Generative AI, such as Large Language Models (LLMs). + +## The Importance of OpenVINO on openSUSE Linux + +- **Seamless Hardware and Software Integration:** OpenVINO provides native acceleration for Intel CPUs and GPUs while maintaining flexibility to support other platforms. When paired with openSUSE Linux’s optimized kernel and advanced library compatibility, OpenVINO reaches its full potential. +- **Generative AI in Open Source:** In the era of Generative AI, tools like OpenVINO democratize access to cutting-edge technologies, allowing developers of all levels to create advanced solutions directly on openSUSE without requiring expensive proprietary hardware. +- **Performance and Efficiency:** OpenVINO significantly reduces inference times and resource usage, a critical feature for LLM-based applications processing large amounts of data in real-time. +- **Developer Simplicity:** One of OpenVINO’s greatest advantages is its accessibility. It enables even beginner developers to build robust applications with minimal code while still offering flexibility and customization for advanced projects. + +# Building an LLM Application in 3 Lines of Code + +With OpenVINO, creating an application using a generative language model is as simple as: + +``` +import openvino_genai as ov_genai +pipe = ov_genai.LLMPipeline("TinyLlama-1.1B-Chat-v1.0/", "CPU") +print(pipe.generate("Openvino é", max_new_tokens=100, do_sample=False)) +``` + +This simplicity highlights how OpenVINO allows seamless integration of Generative AI technologies into openSUSE Linux, combining optimization with ease of use. + +##Conclusion + +The presence of OpenVINO on openSUSE Linux reinforces the role of open source in leading technological advancements in the AI era. It empowers businesses, independent developers, and enthusiasts to build efficient, scalable, and impactful applications. With tools like OpenVINO, openSUSE solidifies its position as a powerful platform for innovation in Generative +