Skip to content

Commit

Permalink
Merge pull request #296 from cabelo/master
Browse files Browse the repository at this point in the history
OpenVINO 2024.6.0. Thanks @cabelo I will make some small changes.
  • Loading branch information
ddemaio authored Jan 14, 2025
2 parents 718677f + 5d1f850 commit 0c6e1ce
Showing 1 changed file with 51 additions and 0 deletions.
51 changes: 51 additions & 0 deletions _posts/2025/2025-01-14-openvino-202460.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
---
author: Alessandro de Oliveira Faria
date: 2024-05-14 05:30:00
layout: post
license: CC-BY-SA-3.0
title: OpenVINO with Generative AI
image: /wp-content/uploads/2024/05/openvino.png
categories:
- openSUSE
- Announcements
- Tumbleweed
tags:
- openSUSE
- Innovators
- OpenCV
- OpenVINO
- GPU
- VPU
- NPU
- Artificial Intelligence
- Machine Learning community

---

As always focused on the [openSUSE Innovator initiative](https://en.opensuse.org/openSUSE:INNOVATORS) and as an openSUSE and [Intel Innovator](https://www.intel.com/content/www/us/en/developer/articles/community/experts-de-oliveira-faria.html) member, I continue to strive to help keep the [openVINO](https://software.opensuse.org/package/openvino) repository up to date with the openSUSE Linux distribution community.

OpenVINO (Open Visual Inference and Neural Network Optimization) is one of the most crucial tools in the AI ecosystem, especially for applications requiring optimized performance for deep learning model inference. The 2024.6.0 release brings significant advancements in compatibility, optimizations, and support for complex models, including those used in Generative AI, such as Large Language Models (LLMs).

## The Importance of OpenVINO on openSUSE Linux

- **Seamless Hardware and Software Integration:** OpenVINO provides native acceleration for Intel CPUs and GPUs while maintaining flexibility to support other platforms. When paired with openSUSE Linux’s optimized kernel and advanced library compatibility, OpenVINO reaches its full potential.
- **Generative AI in Open Source:** In the era of Generative AI, tools like OpenVINO democratize access to cutting-edge technologies, allowing developers of all levels to create advanced solutions directly on openSUSE without requiring expensive proprietary hardware.
- **Performance and Efficiency:** OpenVINO significantly reduces inference times and resource usage, a critical feature for LLM-based applications processing large amounts of data in real-time.
- **Developer Simplicity:** One of OpenVINO’s greatest advantages is its accessibility. It enables even beginner developers to build robust applications with minimal code while still offering flexibility and customization for advanced projects.

# Building an LLM Application in 3 Lines of Code

With OpenVINO, creating an application using a generative language model is as simple as:

```
import openvino_genai as ov_genai
pipe = ov_genai.LLMPipeline("TinyLlama-1.1B-Chat-v1.0/", "CPU")
print(pipe.generate("Openvino é", max_new_tokens=100, do_sample=False))
```

This simplicity highlights how OpenVINO allows seamless integration of Generative AI technologies into openSUSE Linux, combining optimization with ease of use.

##Conclusion

The presence of OpenVINO on openSUSE Linux reinforces the role of open source in leading technological advancements in the AI era. It empowers businesses, independent developers, and enthusiasts to build efficient, scalable, and impactful applications. With tools like OpenVINO, openSUSE solidifies its position as a powerful platform for innovation in Generative

0 comments on commit 0c6e1ce

Please sign in to comment.