LibRaw 0.19.5-Release

We're happy to announce LibRaw 0.19.5 Release

Available at:

    LibRaw 0.19.5 Release changes

  • WB coefficients check was too strong, weakened
  • Fixed possible buffer underrun in modern Samsung loader

LibRaw 0.19.4 Release changes

  • CRW/metadata loop prevention code is rolled back due to ABI incompatibility. To enable, use -DLIBRAW_METADATA_LOOP_PREVENTION=1 compile flag for LibRaw and ALL APPS.
  • Fixed possible buffer underflow

LibRaw 0.19.3 Release changes

  • Several fixes inspired by OSS-Fuzz
  • Note: ABI slightly changed, new variable added at end of class LibRaw Generally, all old code should run w/o recompile, but you're warned...

LibRaw 0.19.2 Release changes

  • Fixed possible buffer overrun at Fuji makernotes parser
  • Fixed possible write to NULL pointer at raw2image/raw2image_ex calls.
    Details:
    • Three different CVE numbers was assigned for single problem: CVE-2018-20363, CVE-2018-20364, CVE-2018-20365
    • The POCs exploits inconsistency in Sinar-4Shot files handling. LibRaw 0.19 does not support this files format, so it is not subject of exactly same problem
    • However, additional checks for bayer raw data presence are backported from LibRaw-master (development) branch.

LibRaw 0.19.1 Release changes

  • Finally: got Sinar 4shot sample, works fine now
  • OpenMP critical sections for malloc/free; extra #ifdefs removed; bin/dcraw_dist could be built again using Makefile.devel
  • additional checks in parse_phase_one()
  • more checks on file offsets/tag len in parse_minolta
  • more checks in parse_ciff
  • Mempool check reworked
  • Old Leaf (16bit/3color/TIFF) support
  • Fix cameraWB->autoWB fallback
  • Polaroid x530 channel swap; get metadata pointer for Foveon files
  • Fixed Secunia Advisory SA86384
    • possible infinite loop in unpacked_load_raw()
    • possible infinite loop in parse_rollei()
    • possible infinite loop in parse_sinar_ia()
    Credits: Laurent Delosieres, Secunia Research at Flexera

LibRaw 0.19 Release changes

  • changed wrong fix for Canon D30 white balance
  • fixed possible stack overrun while reading zero-sized strings
  • fixed possible integer overflow

LibRaw 0.19 Beta-6 changes

  • Sony uncompressed/untiled DNGs: do not set bits-per-sample to 14 bit
  • Do not change tiff_bps for DNG files
  • Another possible stack overflow in kodak radc reader
  • Secunia Advisory SA83507, credits Kasper Leigh Haabb, Secunia Research at Flexera
    • parse_qt: possible integer overflow
    • reject broken/crafted NOKIARAW files

LibRaw 0.19 Beta-5 changes

  • Put rogue printf's behind #ifdef DCRAW_VERBOSE
  • Exceptions was not caught in x3f_new_from_file resulting in x3f handle leak
  • packed_load_raw(): EOF check on each row
  • define LIBRAW_USE_CALLOC_INSTEAD_OF_MALLOC to use ::calloc instead of ::malloc in LibRaw_mem_mgr malloc calls; Note: realloc is not changed, so only partial fix
  • Fixed possible div by zero in EOS D30 WB data parse
  • U-suffix for filter-var manipulation consts
  • restored static specifier for utf2char() lost in previous bugfix
  • Fixed stack overrun in kodak_radc_load_raw
  • Secunia Advisory SA83050: possible infinite loop in parse_minolta()

LibRaw 0.19 Beta-4 changes

  • CVE-2018-10529 fixed: out of bounds read in X3F parser
  • CVE-2018-10528 fixed: possible stack overrun in X3F parser

LibRaw 0.19 Beta-3 changes

  • Secunia 81800 advisory
  • lot of bugs reported by ImageMagic/oss-fuzz fixed

LibRaw 0.19 Beta-2 changes

  • Better handling of broken JPEG thumbnails
  • Panasonic GH5S/G9-hires decoder, thanks to Alexey Danilchenko
    Note: ABI has changed due to this patch, so shlib version increased
  • Fujifilm X-A5/A20 metadata parsing fix
  • New error code LIBRAW_TOO_BIG: image data size excess LIBRAW_MAX_ALLOC_MB
  • winsock2 included before windows.h to make MinGW happy

Changes (from 0.18)

  • 84 cameras added compared to 0.18 (1014 total):
    Apple
    iPhone 8(*), iPhone 8 plus, iPhone X
    BlackMagic
    URSA Mini 4k, URSA Mini 4.6k, URSA Mini Pro 4.6k
    Canon CHDK hack
    PowerShot A410, A540, D10, ELPH 130 IS, ELPH 160 IS, SD750, SX100 IS,SX130 IS, SX160 IS, SX510 HS, SX10 IS, IXUS 900Ti
    Canon
    PowerShot G1 X Mark III, G9 X Mark II, EOS 6D Mark II, EOS 77D, EOS 200D, EOS 800D, EOS M6, EOS M100
    Casio EX-ZR4100/5100
    DJI
    Phantom4 Pro/Pro+, Zenmuse X5, Zenmuse X5R
    FujiFilm
    S6500fd, GFX 50S, X100f, X-A3, X-A5, X-A10, X-A20, X-E3, X-H1, X-T20
    GITUP GIT2P
    Hasselblad
    H6D-100c, A6D-100c
    Huawei
    P9 (EVA-L09/AL00), Honor6a, Honor9, Mate10 (BLA-L29)
    Leica
    CL, M10, TL2
    LG
    V20 (F800K), VS995
    Nikon
    D850, D5600, D7500, Coolpix B700
    Olympus
    E-PL9, E-M10 Mark III, TG-5
    OnePlus
    One, A3303, A5000
    Panasonic
    DMC-FZ45, DMC-FZ72, DC-FZ80/82, DC-G9 (std. res mode only), DC-GF10/GF90, DC-GH5, DC-GX9, DC-GX800/850/GF9, DMC-LX1, DC-ZS70 (DC-TZ90/91/92, DC-T93), DC-TZ100/101/ZS100, DC-TZ200/ZS200
    PARROT
    Bebop 2, Bebop Drone
    Pentax KP
    PhaseOne IQ3 100MP Trichromatic
    Samsung
    Galaxy Nexus, Galaxy S3, S6 (SM-G920F), S7, S7 Edge, S8 (SM-G950U)
    Sony
    A7R III, A9, DSC-RX0, DSC-RX10IV
    Yi M1
    YUNEEC
    CGO3, CGO3P
    Xiaoyi YIAC3 (YI 4k)

    Note(*): for mobile phones with DNG format recording, only the cameras we tested ourselves are added to supported camera list. As a matter of fact LibRaw should support any correctly formatted DNG file.

  • No more built-in support for LibRaw demosaic packs (GPL2/GPL3). We're unable to support this (very old code), so we'll be happy to transfer this code to some maintainer who wish to work with it.

    In LibRaw 0.19 we provide extension API: user-settable callbacks to be called in code points where demosaic pack code was called.

    • int callbacks.pre_identify_cb(void *) => to be called in LibRaw::open_datastream before call to (standard) identify() function. If this call returns 1, this means that RAW file is identified and all metadata fields are set, so no need to run standard identify code.
    • void callbacks.post_identify_cb(void*) => called just after identify(), but before any cleanup code;
    • dcraw_process() callbacks are called before dcraw_process phases (name speaks for itself): pre_subtractblack_cb, pre_scalecolors_cb, pre_preinterpolate_cb, pre_interpolate_cb, interpolate_bayer_cb, interpolate_xtrans_cb, post_interpolate_cb, pre_converttorgb_cb, post_converttorgb_cb

    All these new callbacks are called with (this) as the only arg. To continue LibRaw-demosaic-pack-GPLx support one need to subclass LibRaw, set needed callbacks in (e.g.) constructor code, than these callbacks to be called

  • Better DNG parser:
    • support for DefaultCrop Origin/Size tags (add LIBRAW_PROCESSING_USE_DNG_DEFAULT_CROP to raw_processing_options to enable)
    • better parsing for nested DNG tags (use tag from RAW IFD, fallback to IFD0 if no tag in current IFD)
    • DNG PreviewColorspace extracted into dng_levels.preview_colorspace
  • Metadata extraction:
    • Better extraction of camera measured balance (LIBRAW_WBI_Auto and WBI_Measured), this not the same as 'as shot' if some preset/manual tune is used.
    • Extraction of camera custom balances (LIBRAW_WBI_CustomN)
    • Nikon data compression tag extracted into makernotes.nikon.NEFCompression
    • Hasselblad BaseISO and Gain extracted into makernotes.hasselblad
    • Canon multishot params extracted into makernotes.canon.multishot
    • lot of other vendor-specific makernotes data (see data structures definitions for details).
  • New LibRaw::open_bayer call allows to pass sensor dump w/o metadata directly to LibRaw
  • Color data added/updated/fixed for many cameras
  • Correct data maximum for Fuji X-* cameras
  • Thumbnail processing:
    • JPEG thumbnails: if compiled with libjpeg, color count is extracted into imgdata.thumbnail.tcolors
    • PPM (bitmap) thumbnails: color count is set according to thumbnail IFD tag
    • PPM16 thumbnails: if LIBRAW_PROCESSING_USE_PPM16_THUMBS set in raw_processing_options, than thumbnail will be extracted as is, not converted to 8 bit. thumbnail.tformat is set to LIBRAW_THUMBNAIL_BITMAP16 in this case. Untested, because it is hard to find RAWs with 16-bit bitmaps.
  • Compatibility fixes
    • struct tiff_tag renamed to libraw_tiff_tag
    • pow64f renamed to libraw_pow64f
  • Bugs fixed:
    • COLOR(r,c) works correctly on X-Trans files
  • Security fixes:
      Secunia #81000: Credit: Laurent Delosieres, Secunia Research at Flexera
      • leaf_hdr_load_raw: check for image pointer for demosaiced raw
      • NOKIARAW parser: check image dimensions readed from file
      • quicktake_100_load_raw: check width/height limits
    • Secunia #79000: Credit: Laurent Delosieres, Secunia Research at Flexera
      • All legacy (RGB raw) image loaders checks for imgdata.image is not NULL
      • kodak_radc_load_raw: check image size before processing
      • legacy memory allocator: allocate max(widh,raw_width)*max(height,raw_height)
    • Secunia #76000:
      • Fixed fuji_width handling if file is neither fuji nor DNG
      • Fixed xtrans interpolate for broken xtrans pattern
      • Fixed panasonic decoder
    • Other fixes:
      • Checks for width+left_margin/height+top_margin not larger than 64k
      • LIBRAW_MAX_ALLOC_MB define limits maximum image/raw_image allocation (default is 2048 so 2Gb per array)
      • LibRaw::read_shorts item count is now unsigned
      • Fixed possible out of bound access in Kodak 65000 loader
      • CVE-2017-14348: Fix for possible heap overrun in Canon makernotes parser Credit: Henri Salo from Nixu Corporation
      • Fix for CVE-2017-13735
      • CVE-2017-14265: Additional check for X-Trans CFA pattern data
      • Fixed several errors (Secunia advisory SA75000)
      • ACES colorspace output option included in dcraw_emu help page
      • Avoided possible 32-bit overflows in Sony metadata parser
      • Phase One flat field code called even for half-size

Comments

EOS 80D image size

Hi,

I've noticed that LibRaw decodes 6022 x 4020 Pixels from the sensors used in Canons EOS 80D, 200D, 77D etc.,
while DNG-Converter (and original DCRAW) decode 6024 x 4022 Pixels.
Can this be changed?
I ask because calibration images (darks, flats, bias, bad-pixel maps) for astro imaging cannot be used cross wise.

Greetings, Erwin

Could you please specify what

Could you please specify what need to be fixed: left/top margin(s), or visible area only?

-- Alex Tutubalin @LibRaw LLC

I have RAWs available from

I have RAWs available from the 80D and the 200D:

80D, LibRaw: 6022 x 4020
80D, DCRAW: 6024 x 4022, 2 more cols on the left side, 2 extra rows at the top
80D, DNG-Converter: Same as DCRAW

200D, LibRaw: 6022 x 4020
200D, DCRAW: 6024 x 4020, 2 more cols on the left side of the image
200D, DNG-Converter: Same as DCRAW

Strange that the sizes are equal in DNG-Converter and DCRAW, but different for the two cameras.

I've now checked also images

I've now checked also images from the 800D and 77D models:
DNG-Converter converts to 6024x4022, and DCRAW reports 6024x4020.

And I found that with both models the additional top rows of the DNGs are black!
So the correct size seems to be 6024x4020.
Since there is no chance to have a common and correct size, I think it might be the best to not change anything.

Thank you for your feedback

Thank you for your feedback and attention to details. Case closed.

-- Alex Tutubalin @LibRaw LLC

Hey there! Thanks for your

Hey there! Thanks for your work! Will you add CR3 support to LibRaw?

CR3 support is expected in

CR3 support is expected in next public snapshot this Fall

-- Alex Tutubalin @LibRaw LLC

Is the code with CR3 support

Is the code with CR3 support available in some private branch? I would like to test if it is available.

Universal Binary lib for macOS 11

Hi,
I work currently on the port of my app for macOS 11 on ARM/Intel.
When will be a Universal Binary available?
Thorsten

We do not have ARM mac

We do not have ARM mac hardware, so unable to test. I do not think we'll have it in very nearest future.

You need to rebuild LibRaw by yourself, use Makefile.dist as a starting point.

-- Alex Tutubalin @LibRaw LLC

make -f Makefile.dist worked

make -f Makefile.dist worked on Intel and ARM. I merged both libs with lipo.
Should I change any settings in the Makefile from the default?

Libraw binary distribution

Libraw binary distribution for Mac is built using unedited Makefile.dist

-- Alex Tutubalin @LibRaw LLC