fix: add default cpu_threads

[vansangpfiev]

Describe Your Changes

This pull request includes several changes to the ModelService and utility files to improve functionality and error handling. The most important changes include adding a method to determine the number of CPU threads, enhancing error handling for file operations, and minor adjustments to file includes.

Enhancements to ModelService:

• Added a method GetCpuThreads to determine the number of CPU threads based on the hardware and engine mode. This method is used to set a default value for cpu_threads if it is not configured. (engine/services/model_service.cc, engine/services/model_service.h) [1] [2] [3]

Error handling improvements:

• Improved error handling in GGUFHelper::Load by checking if the file descriptor is valid and logging an error message if the file cannot be opened. (engine/utils/hardware/gguf/gguf_file.h)

Minor adjustments:

• Rearranged the order of include directives to maintain consistency and potentially resolve dependency issues. (engine/utils/hardware/gguf/gguf_file.h) [1] [2]
• Moved the initialization of Estimation res in EstimateLLaMACppRun to ensure it is correctly initialized after parsing the GGUF file. (engine/utils/hardware/gguf/gguf_file_estimate.h)

Fixes Issues

• Investigate: Cortex uses significant CPU #1883

Self Checklist

• Added relevant comments, esp in complex areas
• Updated docs (for bug fixes / features)
• Created issues for follow-up changes or refactoring needed