Skip to content

Filling some Int4 tensor feature gaps after tensor subclass migration #3013

@jerryzh168

Description

@jerryzh168

Add AWQ Support for int4 dtypes

Similar to #2753 we want to add AWQ support for other types of int4 tensors, right now only added for Int4Tensor.

Add HQQ option

Example: #2912

  • Int4OpaqueTensor
  • Int4PlainInt32Tensor

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions