Conversation regarding external metadata:
[1:36 PM] MF: hey guys - I'm testing using external metadata to store some base64 encoded thumbnail images against records in my index, but the data is being truncated. I'm using large values for -mdsfml in my indexer_options but the stored data seems to cap out at 100,000 chars regardless. The documentation infers the limit is 2^31 - any ideas?
[1:43 PM] RB: I assume you also set the MBL query processor option?
[1:47 PM] MF: Hmm I haven't (I'm guessing I need to), but I'm seeing the truncated data using padre-di to dump it out
[1:47 PM] MF: I haven't got to querying it yet
[1:47 PM] RB: best case scenario for you is padre-di truncating it
[1:48 PM] RB: try it with the QPO
[1:48 PM] RB: see if padre-sw also truncates
[1:54 PM] MF: ah cool, thanks I'll try that
[1:54 PM] PL: hm don't like your chances if padre-di is truncating it
[1:58 PM] MF: @PeterLevan is right, it didn't work. I increased MBL but only get 100000 characters back
[2:05 PM] RB: sounds like a limitation with ext md then, I have indexed base64 encoded images in a local collection as XML in the past
[2:08 PM] MF: Thanks @RB, for now I'll look at tackling it a different way