-
Notifications
You must be signed in to change notification settings - Fork 70
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #296 from cabelo/master
OpenVINO 2024.6.0. Thanks @cabelo I will make some small changes.
- Loading branch information
Showing
1 changed file
with
51 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,51 @@ | ||
--- | ||
author: Alessandro de Oliveira Faria | ||
date: 2024-05-14 05:30:00 | ||
layout: post | ||
license: CC-BY-SA-3.0 | ||
title: OpenVINO with Generative AI | ||
image: /wp-content/uploads/2024/05/openvino.png | ||
categories: | ||
- openSUSE | ||
- Announcements | ||
- Tumbleweed | ||
tags: | ||
- openSUSE | ||
- Innovators | ||
- OpenCV | ||
- OpenVINO | ||
- GPU | ||
- VPU | ||
- NPU | ||
- Artificial Intelligence | ||
- Machine Learning community | ||
|
||
--- | ||
|
||
As always focused on the [openSUSE Innovator initiative](https://en.opensuse.org/openSUSE:INNOVATORS) and as an openSUSE and [Intel Innovator](https://www.intel.com/content/www/us/en/developer/articles/community/experts-de-oliveira-faria.html) member, I continue to strive to help keep the [openVINO](https://software.opensuse.org/package/openvino) repository up to date with the openSUSE Linux distribution community. | ||
|
||
OpenVINO (Open Visual Inference and Neural Network Optimization) is one of the most crucial tools in the AI ecosystem, especially for applications requiring optimized performance for deep learning model inference. The 2024.6.0 release brings significant advancements in compatibility, optimizations, and support for complex models, including those used in Generative AI, such as Large Language Models (LLMs). | ||
|
||
## The Importance of OpenVINO on openSUSE Linux | ||
|
||
- **Seamless Hardware and Software Integration:** OpenVINO provides native acceleration for Intel CPUs and GPUs while maintaining flexibility to support other platforms. When paired with openSUSE Linux’s optimized kernel and advanced library compatibility, OpenVINO reaches its full potential. | ||
- **Generative AI in Open Source:** In the era of Generative AI, tools like OpenVINO democratize access to cutting-edge technologies, allowing developers of all levels to create advanced solutions directly on openSUSE without requiring expensive proprietary hardware. | ||
- **Performance and Efficiency:** OpenVINO significantly reduces inference times and resource usage, a critical feature for LLM-based applications processing large amounts of data in real-time. | ||
- **Developer Simplicity:** One of OpenVINO’s greatest advantages is its accessibility. It enables even beginner developers to build robust applications with minimal code while still offering flexibility and customization for advanced projects. | ||
|
||
# Building an LLM Application in 3 Lines of Code | ||
|
||
With OpenVINO, creating an application using a generative language model is as simple as: | ||
|
||
``` | ||
import openvino_genai as ov_genai | ||
pipe = ov_genai.LLMPipeline("TinyLlama-1.1B-Chat-v1.0/", "CPU") | ||
print(pipe.generate("Openvino é", max_new_tokens=100, do_sample=False)) | ||
``` | ||
|
||
This simplicity highlights how OpenVINO allows seamless integration of Generative AI technologies into openSUSE Linux, combining optimization with ease of use. | ||
|
||
##Conclusion | ||
|
||
The presence of OpenVINO on openSUSE Linux reinforces the role of open source in leading technological advancements in the AI era. It empowers businesses, independent developers, and enthusiasts to build efficient, scalable, and impactful applications. With tools like OpenVINO, openSUSE solidifies its position as a powerful platform for innovation in Generative | ||
|