[Reorg Folder] reorg transformers and langchain folders

[zhentaoyu]

Type of Change

as title

Description

detail description
JIRA ticket: xxx

1. llm/ --> transformers/llm
2. setfit/ --> transformers/setfit
3. add GenAI in examples
4. add llama_index

   llama_index/
        __init__.py

5. add haystack

   hay_stack/
       __init__.py

6. rename langchain to langchain_community

 langchain/
    langchain_community/  <older langchain folder>
        __init__.py
       embeddings/
       xxx

usage:
import intel_extension_for_transformers.langchain_community.embeddings as e

7. llm/runtime/deprecated ---> runtime/ and remove llm/runtime/neural_speed
8. remove useless files in utils folder and rename it to tools.

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

[zhentaoyu]

neural_chat tts_chinese ut failure (reason is unknown, paddlepaddle related) may be solved by this pr: #1139

[VincyZhang]

CI-summary failed due to too many files changed, exceed maximum of github comment, but is not caused by this PR.

[github-actions]

🌩️ Required checks status: Pending 🟡

Groups summary

🟢 Format Scan Tests workflow

Check ID	Status	Error details
format-scan (pylint)	success		✅
format-scan (bandit)	success		✅
format-scan (cloc)	success		✅
format-scan (cpplint)	success		✅

These checks are required after the changes to intel_extension_for_transformers/__init__.py, intel_extension_for_transformers/haystack/__init__.py, intel_extension_for_transformers/langchain/langchain_community/__init__.py, intel_extension_for_transformers/langchain/langchain_community/embeddings/__init__.py, intel_extension_for_transformers/langchain/langchain_community/embeddings/embeddings.py, intel_extension_for_transformers/langchain/langchain_community/embeddings/optimized_instructor_embedding.py, intel_extension_for_transformers/langchain/langchain_community/embeddings/optimized_sentence_transformers.py, intel_extension_for_transformers/langchain/langchain_community/embeddings/requirements.txt, intel_extension_for_transformers/langchain/langchain_community/retrievers/__init__.py, intel_extension_for_transformers/langchain/langchain_community/retrievers/bge_reranker.py, intel_extension_for_transformers/langchain/langchain_community/retrievers/child_parent_retriever.py, intel_extension_for_transformers/langchain/langchain_community/vectorstores/__init__.py, intel_extension_for_transformers/langchain/langchain_community/vectorstores/chroma.py, intel_extension_for_transformers/langchain/langchain_community/vectorstores/qdrant.py, intel_extension_for_transformers/llama_index/__init__.py, intel_extension_for_transformers/llm/runtime/neural_speed/README.md, intel_extension_for_transformers/llm/runtime/neural_speed/requirements.txt, intel_extension_for_transformers/neural_chat/README.md, intel_extension_for_transformers/neural_chat/chatbot.py, intel_extension_for_transformers/neural_chat/docs/notebooks/langchain_extension_api.ipynb and 1024 more files...

🟢 Optimize Unit Test workflow

Check ID	Status	Error details
optimize-unit-test-baseline	success		✅
optimize-unit-test-PR-test	success		✅
Genreate-OptimizeUT-Report	success		✅

These checks are required after the changes to intel_extension_for_transformers/transformers/dpo_trainer.py, intel_extension_for_transformers/transformers/llm/__init__.py, intel_extension_for_transformers/transformers/llm/amp/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/bigcode_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/bigcode_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/datasets/cnn_dailymail.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/datasets/cnn_validation.json, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/hf_datasets/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/hf_datasets/cnn_dailymail.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/models/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/models/huggingface.py, intel_extension_for_transformers/transformers/llm/evaluation/models.py, intel_extension_for_transformers/transformers/llm/finetuning/__init__.py, intel_extension_for_transformers/transformers/llm/finetuning/config/finetuning.yaml, intel_extension_for_transformers/transformers/llm/finetuning/data_utils.py and 982 more files...

🟢 Neural Speed Unit Test workflow

Check ID	Status	Error details
neural-speed-unit-test	success		✅

These checks are required after the changes to .github/workflows/unit-test-neuralspeed.yml.

🟢 NeuralChat Unit Test

Check ID	Status	Error details
neuralchat-unit-test-baseline	success		✅
neuralchat-unit-test-PR-test	success		✅
Generate-NeuralChat-Report	success		✅

These checks are required after the changes to .github/workflows/unit-test-neuralchat.yml, intel_extension_for_transformers/neural_chat/chatbot.py, intel_extension_for_transformers/neural_chat/models/model_utils.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/image2image/diffusion_utils.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/README.md, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/retrieval_agent.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/retriever_adapter.py, intel_extension_for_transformers/neural_chat/tests/ci/api/test_chatbot_exception.py, intel_extension_for_transformers/neural_chat/tests/ci/utils/test_device_utils.py, intel_extension_for_transformers/neural_chat/tests/nightly/finetuning/test_finetuning.py, intel_extension_for_transformers/neural_chat/tests/nightly/finetuning/test_finetuning_data.py, intel_extension_for_transformers/neural_chat/utils/common.py, intel_extension_for_transformers/neural_chat/utils/error_utils.py, requirements.txt, setup.py, intel_extension_for_transformers/transformers/llm/finetuning/__init__.py, intel_extension_for_transformers/transformers/llm/finetuning/config/finetuning.yaml, intel_extension_for_transformers/transformers/llm/finetuning/data_utils.py, intel_extension_for_transformers/transformers/llm/finetuning/eval_utils.py, intel_extension_for_transformers/transformers/llm/finetuning/finetuning.py and 996 more files...

🟢 Engine Unit Test workflow

Check ID	Status	Error details
engine-unit-test-baseline	success		✅
engine-unit-test-PR-test	success		✅
Genreate-Engine-Report	success		✅

These checks are required after the changes to .github/workflows/unit-test-engine.yml, requirements.txt, setup.py, intel_extension_for_transformers/transformers/dpo_trainer.py, intel_extension_for_transformers/transformers/llm/__init__.py, intel_extension_for_transformers/transformers/llm/amp/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/bigcode_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/bigcode_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/datasets/cnn_dailymail.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/datasets/cnn_validation.json, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/hf_datasets/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/hf_eval/hf_datasets/cnn_dailymail.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/evaluator.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/models/__init__.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/models/huggingface.py, intel_extension_for_transformers/transformers/llm/evaluation/models.py and 644 more files...

🟢 Windows Binary Test

Check ID	Status	Error details
Windows-Binary-Test	success		✅

These checks are required after the changes to .github/workflows/windows-test.yml, requirements.txt, setup.py, intel_extension_for_transformers/transformers/runtime/CMakeLists.txt, intel_extension_for_transformers/transformers/runtime/CMakePresets.json, intel_extension_for_transformers/transformers/runtime/__init__.py, intel_extension_for_transformers/transformers/runtime/cmake/PresetOs.cmake, intel_extension_for_transformers/transformers/runtime/compile/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/compile.py, intel_extension_for_transformers/transformers/runtime/compile/dynamic_quantize.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/onnx_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/tf_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/torch_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/graph/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/graph/graph.py, intel_extension_for_transformers/transformers/runtime/compile/graph_utils.py, intel_extension_for_transformers/transformers/runtime/compile/loaders/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/loaders/loader.py and 638 more files...

🟡 SparseLib Tests workflow

Check ID	Status	Error details
sparselib	no_status		❓

These checks are required after the changes to intel_extension_for_transformers/transformers/runtime/kernels/CMakeLists.txt, intel_extension_for_transformers/transformers/runtime/kernels/README.md, intel_extension_for_transformers/transformers/runtime/kernels/cmake/Common.cmake, intel_extension_for_transformers/transformers/runtime/kernels/cmake/FindOpenMP.cmake, intel_extension_for_transformers/transformers/runtime/kernels/cmake/FindVTune.cmake, intel_extension_for_transformers/transformers/runtime/kernels/cmake/Utility.cmake, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/2D_to_3D.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/3D_spmm.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/4x16_to_vnni_format.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/cache_inconsistency.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/cache_mapping.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/gpu_naive_gemm.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/gpu_tile_sparse_gemm.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_amx_bf16x16_calc.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_amx_bf16x16_relayout.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_avx512f_pattern_base.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_avx512f_pattern_unroll4.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_dynamic_quant_matmul_MN_parallel.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_dynamic_quant_matmul_perf_chat.png, intel_extension_for_transformers/transformers/runtime/kernels/docs/imgs/kernel_dynamic_quant_matmul_wei_preprocess.png and 260 more files...

🟢 LLM Model Test workflow

Check ID	Status	Error details
LLM-Workflow (gpt-j-6b, engine, latency, bf16,int8,fp8)	success		✅
Generate-LLM-Report	success		✅

These checks are required after the changes to .github/workflows/llm-test.yml, intel_extension_for_transformers/transformers/runtime/CMakeLists.txt, intel_extension_for_transformers/transformers/runtime/CMakePresets.json, intel_extension_for_transformers/transformers/runtime/__init__.py, intel_extension_for_transformers/transformers/runtime/cmake/PresetOs.cmake, intel_extension_for_transformers/transformers/runtime/compile/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/compile.py, intel_extension_for_transformers/transformers/runtime/compile/dynamic_quantize.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/onnx_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/tf_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/extractors/torch_extractor.py, intel_extension_for_transformers/transformers/runtime/compile/graph/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/graph/graph.py, intel_extension_for_transformers/transformers/runtime/compile/graph_utils.py, intel_extension_for_transformers/transformers/runtime/compile/loaders/__init__.py, intel_extension_for_transformers/transformers/runtime/compile/loaders/loader.py, intel_extension_for_transformers/transformers/runtime/compile/logger.py, intel_extension_for_transformers/transformers/runtime/compile/onnx_utils.py and 335 more files...

🟢 Chat Bot Test workflow

Check ID	Status	Error details
call-inference-llama-2-7b-chat-hf / inference test	success		✅
call-inference-mpt-7b-chat / inference test	success		✅

These checks are required after the changes to .github/workflows/chatbot-test.yml, intel_extension_for_transformers/neural_chat/chatbot.py, intel_extension_for_transformers/neural_chat/models/model_utils.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/image2image/diffusion_utils.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/README.md, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/retrieval_agent.py, intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/retriever_adapter.py, intel_extension_for_transformers/neural_chat/tests/nightly/finetuning/test_finetuning.py, intel_extension_for_transformers/neural_chat/tests/nightly/finetuning/test_finetuning_data.py, intel_extension_for_transformers/neural_chat/utils/common.py, intel_extension_for_transformers/neural_chat/utils/error_utils.py, intel_extension_for_transformers/transformers/llm/finetuning/__init__.py, intel_extension_for_transformers/transformers/llm/finetuning/config/finetuning.yaml, intel_extension_for_transformers/transformers/llm/finetuning/data_utils.py, intel_extension_for_transformers/transformers/llm/finetuning/eval_utils.py, intel_extension_for_transformers/transformers/llm/finetuning/finetuning.py, intel_extension_for_transformers/transformers/llm/quantization/__init__.py, intel_extension_for_transformers/transformers/llm/quantization/autograd/__init__.py, intel_extension_for_transformers/transformers/llm/quantization/autograd/functions.py, intel_extension_for_transformers/transformers/llm/quantization/nn/__init__.py and 982 more files...

---

Thank you for your contribution! 💜

Note
This comment is automatically generated and updates for 360 minutes every 180 seconds. If you have any other questions, contact VincyZhang or XuehaoSun for help.

[ftian1]

1. should leave llama-index and haystack folder empty. only contain a init.py
2. should remove content in utils folder. put carbon_calc.py to tools folder and remove others.

[zhentaoyu]

1. should leave llama-index and haystack folder empty. only contain a init.py
2. should remove content in utils folder. put carbon_calc.py to tools folder and remove others.

done

[ftian1]

looks good to me