Skip to content

UBSAN: runtime error: member access within null pointer of type #257

Open
@JohnSmithBH84

Description

@JohnSmithBH84

Prerequisites

Before submitting your issue, please ensure the following:

  • [v] I am running the latest version of PowerInfer. Development is rapid, and as of now, there are no tagged versions.
  • [v] I have carefully read and followed the instructions in the README.md.
  • [v] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).

Expected Behavior

No problem reported by UBSAN

Current Behavior

PowerInfer/build/bin/finetune
error loading model: llama_model_loader: failed to load model from 

llama_load_model_from_file_with_context: failed to load model
PowerInfer/ggml.c:19835:23: runtime error: member access within null pointer of type 'const struct gguf_context'

Environment and Context

PowerInfer: master

compiler: gcc (Debian 12.2.0-14) 12.2.0

  • Physical (or virtual) hardware you are using, e.g. for Linux:

Ubuntu 22.04.4 LTS
Linux 5.15.0-125-generic #135-Ubuntu SMP Fri Sep 27 13:53:58 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Failure Information (for bugs)

Please help provide information about the failure / bug.

Steps to Reproduce

Launched PowerInfer/build/bin/finetune

I’ve scanned PowerInfer with UBSAN and it has triggered on PowerInfer/ggml.c line 19835. I'm not sure whether this is an actual issue, or whether code of PowerInfer is too sophisticated for UBSAN to understand. Do you guys have any idea?

Failure Logs

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions