VK_KHR_sampler_ycbcr_conversion

Other Extension Metadata

Last Modified Date

2017-08-11

IP Status

No known IP claims.

Contributors

Andrew Garrard, Samsung Electronics
Tobias Hector, Imagination Technologies
James Jones, NVIDIA
Daniel Koch, NVIDIA
Daniel Rakos, AMD
Romain Guy, Google
Jesse Hall, Google
Tom Cooksey, ARM Ltd
Jeff Leger, Qualcomm Technologies, Inc
Jan-Harald Fredriksen, ARM Ltd
Jan Outters, Samsung Electronics
Alon Or-bach, Samsung Electronics
Michael Worcester, Imagination Technologies
Jeff Bolz, NVIDIA
Tony Zlatinski, NVIDIA
Matthew Netsch, Qualcomm Technologies, Inc

The use of Y′C_BC_R sampler conversion is an area in 3D graphics not used by most Vulkan developers. It is mainly used for processing inputs from video decoders and cameras. The use of the extension assumes basic knowledge of Y′C_BC_R concepts.

This extension provides the ability to perform specified color space conversions during texture sampling operations for the Y′C_BC_R color space natively. It also adds a selection of multi-planar formats, image aspect plane, and the ability to bind memory to the planes of an image collectively or separately.

Promotion to Vulkan 1.1

All functionality in this extension is included in core Vulkan 1.1, with the KHR suffix omitted. However, if Vulkan 1.1 is supported and this extension is not, the samplerYcbcrConversion capability is optional. The original type, enum, and command names are still available as aliases of the core functionality.

Promotion to Vulkan 1.4

If Vulkan 1.4 is supported, support for the samplerYcbcrConversion capability is required.

New Object Types

VkSamplerYcbcrConversionKHR

New Commands

New Structures

VkSamplerYcbcrConversionCreateInfoKHR
Extending VkBindImageMemoryInfo:
- VkBindImagePlaneMemoryInfoKHR
Extending VkImageFormatProperties2:
- VkSamplerYcbcrConversionImageFormatPropertiesKHR
Extending VkImageMemoryRequirementsInfo2:
- VkImagePlaneMemoryRequirementsInfoKHR
Extending VkPhysicalDeviceFeatures2, VkDeviceCreateInfo:
- VkPhysicalDeviceSamplerYcbcrConversionFeaturesKHR
Extending VkSamplerCreateInfo, VkImageViewCreateInfo:
- VkSamplerYcbcrConversionInfoKHR

New Enums

New Enum Constants

VK_KHR_SAMPLER_YCBCR_CONVERSION_EXTENSION_NAME
VK_KHR_SAMPLER_YCBCR_CONVERSION_SPEC_VERSION
Extending VkChromaLocation:
- VK_CHROMA_LOCATION_COSITED_EVEN_KHR
- VK_CHROMA_LOCATION_MIDPOINT_KHR
Extending VkFormat:
- VK_FORMAT_B10X6G10X6R10X6G10X6_422_UNORM_4PACK16_KHR
- VK_FORMAT_B12X4G12X4R12X4G12X4_422_UNORM_4PACK16_KHR
- VK_FORMAT_B16G16R16G16_422_UNORM_KHR
- VK_FORMAT_B8G8R8G8_422_UNORM_KHR
- VK_FORMAT_G10X6B10X6G10X6R10X6_422_UNORM_4PACK16_KHR
- VK_FORMAT_G10X6_B10X6R10X6_2PLANE_420_UNORM_3PACK16_KHR
- VK_FORMAT_G10X6_B10X6R10X6_2PLANE_422_UNORM_3PACK16_KHR
- VK_FORMAT_G10X6_B10X6_R10X6_3PLANE_420_UNORM_3PACK16_KHR
- VK_FORMAT_G10X6_B10X6_R10X6_3PLANE_422_UNORM_3PACK16_KHR
- VK_FORMAT_G10X6_B10X6_R10X6_3PLANE_444_UNORM_3PACK16_KHR
- VK_FORMAT_G12X4B12X4G12X4R12X4_422_UNORM_4PACK16_KHR
- VK_FORMAT_G12X4_B12X4R12X4_2PLANE_420_UNORM_3PACK16_KHR
- VK_FORMAT_G12X4_B12X4R12X4_2PLANE_422_UNORM_3PACK16_KHR
- VK_FORMAT_G12X4_B12X4_R12X4_3PLANE_420_UNORM_3PACK16_KHR
- VK_FORMAT_G12X4_B12X4_R12X4_3PLANE_422_UNORM_3PACK16_KHR
- VK_FORMAT_G12X4_B12X4_R12X4_3PLANE_444_UNORM_3PACK16_KHR
- VK_FORMAT_G16B16G16R16_422_UNORM_KHR
- VK_FORMAT_G16_B16R16_2PLANE_420_UNORM_KHR
- VK_FORMAT_G16_B16R16_2PLANE_422_UNORM_KHR
- VK_FORMAT_G16_B16_R16_3PLANE_420_UNORM_KHR
- VK_FORMAT_G16_B16_R16_3PLANE_422_UNORM_KHR
- VK_FORMAT_G16_B16_R16_3PLANE_444_UNORM_KHR
- VK_FORMAT_G8B8G8R8_422_UNORM_KHR
- VK_FORMAT_G8_B8R8_2PLANE_420_UNORM_KHR
- VK_FORMAT_G8_B8R8_2PLANE_422_UNORM_KHR
- VK_FORMAT_G8_B8_R8_3PLANE_420_UNORM_KHR
- VK_FORMAT_G8_B8_R8_3PLANE_422_UNORM_KHR
- VK_FORMAT_G8_B8_R8_3PLANE_444_UNORM_KHR
- VK_FORMAT_R10X6G10X6B10X6A10X6_UNORM_4PACK16_KHR
- VK_FORMAT_R10X6G10X6_UNORM_2PACK16_KHR
- VK_FORMAT_R10X6_UNORM_PACK16_KHR
- VK_FORMAT_R12X4G12X4B12X4A12X4_UNORM_4PACK16_KHR
- VK_FORMAT_R12X4G12X4_UNORM_2PACK16_KHR
- VK_FORMAT_R12X4_UNORM_PACK16_KHR
Extending VkFormatFeatureFlagBits:
- VK_FORMAT_FEATURE_COSITED_CHROMA_SAMPLES_BIT_KHR
- VK_FORMAT_FEATURE_DISJOINT_BIT_KHR
- VK_FORMAT_FEATURE_MIDPOINT_CHROMA_SAMPLES_BIT_KHR
- VK_FORMAT_FEATURE_SAMPLED_IMAGE_YCBCR_CONVERSION_CHROMA_RECONSTRUCTION_EXPLICIT_BIT_KHR
- VK_FORMAT_FEATURE_SAMPLED_IMAGE_YCBCR_CONVERSION_CHROMA_RECONSTRUCTION_EXPLICIT_FORCEABLE_BIT_KHR
- VK_FORMAT_FEATURE_SAMPLED_IMAGE_YCBCR_CONVERSION_LINEAR_FILTER_BIT_KHR
- VK_FORMAT_FEATURE_SAMPLED_IMAGE_YCBCR_CONVERSION_SEPARATE_RECONSTRUCTION_FILTER_BIT_KHR
Extending VkImageAspectFlagBits:
- VK_IMAGE_ASPECT_PLANE_0_BIT_KHR
- VK_IMAGE_ASPECT_PLANE_1_BIT_KHR
- VK_IMAGE_ASPECT_PLANE_2_BIT_KHR
Extending VkImageCreateFlagBits:
- VK_IMAGE_CREATE_DISJOINT_BIT_KHR
Extending VkObjectType:
- VK_OBJECT_TYPE_SAMPLER_YCBCR_CONVERSION_KHR
Extending VkSamplerYcbcrModelConversion:
- VK_SAMPLER_YCBCR_MODEL_CONVERSION_RGB_IDENTITY_KHR
- VK_SAMPLER_YCBCR_MODEL_CONVERSION_YCBCR_2020_KHR
- VK_SAMPLER_YCBCR_MODEL_CONVERSION_YCBCR_601_KHR
- VK_SAMPLER_YCBCR_MODEL_CONVERSION_YCBCR_709_KHR
- VK_SAMPLER_YCBCR_MODEL_CONVERSION_YCBCR_IDENTITY_KHR
Extending VkSamplerYcbcrRange:
- VK_SAMPLER_YCBCR_RANGE_ITU_FULL_KHR
- VK_SAMPLER_YCBCR_RANGE_ITU_NARROW_KHR
Extending VkStructureType:
- VK_STRUCTURE_TYPE_BIND_IMAGE_PLANE_MEMORY_INFO_KHR
- VK_STRUCTURE_TYPE_IMAGE_PLANE_MEMORY_REQUIREMENTS_INFO_KHR
- VK_STRUCTURE_TYPE_PHYSICAL_DEVICE_SAMPLER_YCBCR_CONVERSION_FEATURES_KHR
- VK_STRUCTURE_TYPE_SAMPLER_YCBCR_CONVERSION_CREATE_INFO_KHR
- VK_STRUCTURE_TYPE_SAMPLER_YCBCR_CONVERSION_IMAGE_FORMAT_PROPERTIES_KHR
- VK_STRUCTURE_TYPE_SAMPLER_YCBCR_CONVERSION_INFO_KHR

If VK_EXT_debug_report is supported:

Extending VkDebugReportObjectTypeEXT:
- VK_DEBUG_REPORT_OBJECT_TYPE_SAMPLER_YCBCR_CONVERSION_EXT
- VK_DEBUG_REPORT_OBJECT_TYPE_SAMPLER_YCBCR_CONVERSION_KHR_EXT

Version History

Revision 1, 2017-01-24 (Andrew Garrard)
- Initial draft
Revision 2, 2017-01-25 (Andrew Garrard)
- After initial feedback
Revision 3, 2017-01-27 (Andrew Garrard)
- Higher bit depth formats, renaming, swizzle
Revision 4, 2017-02-22 (Andrew Garrard)
- Added query function, formats as RGB, clarifications
Revision 5, 2017-04-?? (Andrew Garrard)
- Simplified query and removed output conversions
Revision 6, 2017-04-24 (Andrew Garrard)
- Tidying, incorporated new image query, restored transfer functions
Revision 7, 2017-04-25 (Andrew Garrard)
- Added cosited option/midpoint requirement for formats, bypassConversion
Revision 8, 2017-04-25 (Andrew Garrard)
- Simplified further
Revision 9, 2017-04-27 (Andrew Garrard)
- Disjoint no more
Revision 10, 2017-04-28 (Andrew Garrard)
- Restored disjoint
Revision 11, 2017-04-29 (Andrew Garrard)
- Now Ycbcr conversion, and KHR
Revision 12, 2017-06-06 (Andrew Garrard)
- Added conversion to image view creation
Revision 13, 2017-07-13 (Andrew Garrard)
- Allowed cosited-only chroma samples for formats
Revision 14, 2017-08-11 (Andrew Garrard)
- Reflected quantization changes in BT.2100-1