{"id":332,"date":"2025-12-23T18:34:53","date_gmt":"2025-12-23T17:34:53","guid":{"rendered":"https:\/\/project.inria.fr\/dare\/?page_id=332"},"modified":"2025-12-23T19:29:29","modified_gmt":"2025-12-23T18:29:29","slug":"semantic-compression","status":"publish","type":"page","link":"https:\/\/project.inria.fr\/dare\/semantic-compression\/","title":{"rendered":"Semantic compression"},"content":{"rendered":"\n

We have explored how to compress an image at extremely low bitrate. As explained before, in such a bitrate regime, one must leave the objective of faithfully recovering the input image. In other words, the decoded image, instead of resembling the input image pixel by pixel, contains the same high-level information (called semantics), as illustrated in the figure below. This paradigm is called the
semantic compression.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

The formulation is a particular derivation of the general Data Repurposing framework introduced here<\/a>:
minf,g<\/sub> r(Z) + \u03bb\u03a6<\/sub> d(\u03a6(X), \u03a6(U)) – \u03bb\u03c8<\/sub> \u03c8 (U)
where
– f<\/em> and g<\/em> are respectively the encoding and decoding functions.
– X<\/em> and U<\/em> are respectively the original and reconstructed images.
– \u03a6 (.) is a function that gives the semantic of an image. Here, d<\/em> is a distance function between the image semantics.
– \u03c8 (.) is a metric measuring the visual quality of an image<\/p>\n\n\n\n

In this formulation Z<\/em> describes the image semantics and g<\/em> reconstructs an image from this semantic. The most suited tool for that is a diffusion model that is able to generate an image from a condition (a prompt for example). We then build an general coding scheme structure
(illustrated in Figure below).<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

In this scheme, the encoder builds two types of semantic information:
– the condition that is the information for which the train diffusion model is conditioned for.
– a side information that is a complementary information that can be used to complement the condition.<\/p>\n\n\n\n

We have proposed 6 coding schemes that tackle the different research questions.<\/p>\n

What condition?<\/strong><\/p>\n