26. Stability & Bugs Continued....
Suspect Machine Firmware Update Anyone ?
So this is an interesting one, when I booted MQ for the first time, using the 2019/R1.2 version from the dongle (on the 2019 Macbook Pro), I was presented with the "no entry sign".
Then after a short pause, the machine booted itself into the recovery partition on the suspect drive. Not good as this is not write protected.
I'm then asked if I want to install a firmware update, as that is needed to boot the MQ dongle - or so I am told (See second picture below).
This is Apple code telling me this, but unless you are familiar with what is happening here, there is nothing telling you this is the case - you could easily think this is MQ telling you this information.
So I thought I would go along with it - we are in a test environment - it asks for the Wifi password so that it can connect to Apples servers and download the update needed.
This download/update takes place (around 20 minutes or so), the machine reboots and sadly we have achieved nothing - MQ still does not boot from the dongle.
Lets look at this on-screen so you can avoid this trap!
Toto, we are not in Kansas anymore:
If you see this box pop up, you are non longer in MQ - and you will likely change files on the suspect machines hard drive if you go along with this ! So don't do it.
It goes without saying that this is another Gotcha! that really needs to go in a MQ manual update.
Well thats the comedy over for now, back to the review...
Only kidding, I have another one for you;
Whilst minding my own business in MQ and trying not to click on anything that caused a crash, or pull any funny faces (Mac's have cameras you know..) - this little beauty popped up to spoil my fun when I was connecting a destination disk during one of the tests for the review.
My disk was fine and all was well after a reboot.
That is really it now, I don't have anything else, always fun looking at that sort of thing!
27. Features Not Tested:
Unfortunately I was unable to test every single feature of MQ, I can't point out any potential Gotcha's relating or offer my experience with these;
a) Fusion disks
b) Core Storage
c) RAID Arrays
d) Physical image of T2 Machine
e) Functionality with OSX earlier than High Sierra
Please remember this is a hobby website, so my time and funds are limited!
Check Sumuri's product page.
Update: Recently, Sumuri have just released Recon ITR, which is a merger of their Recon Imager Pro product and their Recon Triage (the one that lets you triage a Mac before you image it). This retails at £908/$1199/€1080.
Want to know the kicker ? It also includes a write blocker (the same as SB which is additional for MQ). Now if that is not going to change the marketplace, I don't know what will! Review coming soon, subscribe to be notified!
I thought MQ was going to be the absolute bees-knees when it came to imaging Apple computers, with the promise of Physical Images (with unallocated space) and APFS Queue files being the headline must have features. I was excited!
Its all a bit Plug and Pray:
What I found in testing is that MQ has been almost completely crippled by the recent updates to Apple's hardware and operating systems and to my eyes, has been left to fade into a shadow of its former self due to lack of updates.
BB market this product to prospective customers (not all of which have zen like knowledge of the Apple product lineup) - the marketing hook stating "Image over 185 Apple machines" sounds mighty impressive to your average investigator. Being as polite as possible, they are simply not telling you the real world capabilities of the product on contemporary machines.
When you also consider the "logical data/artefact collection" featuredid not perform well for non-apple applications, (such as Microsoft Office 365) it paints a very dim picture of something that once was - in my opinion the pinnacle of Mac imaging. Perhaps this was down to lack of compatibility with my Mojave operating system on the the test machine - but all I can say is it did not perform well for me.
Can't Boot - Won't Boot:
When you note that most T2 machines from 2019 onwards simply won't boot from the MQ dongle anymore, and anything running Catalina 10.15 or later won't let you do a full loose file collection from the booted suspect machine or a live disk image of the machine, thats three major features that don't work as intended anymore.
These late model machines are what I am seeing now in my investigations, most corporates ditch anything older than 3 years (for tax write-downs and reliability reasons) so the days of seeing anything pre 2018 (which you can boot from with the current MQ dongle) are rapidly diminishing.
The only way forward now to image contemporary machines is to purchase another Apple laptop that you can take out into the field so that you can connect them together via a cable and do Target Disk Mode acquisitions.
Don't forget your Softblock if you need write protection of that TDM suspect machine!
Walking on Eggshells:
We then have the stability issues that I observed in such simple things as dialogue boxes, sure some of this may be Apple's code, but some isn't - I've never seen anything like this before in a released to market "forensic" product.
Hopefully someone senior within Cellbrite will read this review and use this information for the reason it has been put here - to improve the purchasing/usage experience for everybody - and make some changes to the marketing material.
It is not a bad product, it just has some silly periphery issues.
Be Up Front:
Just being a little more upfront about the latest Apple imposed limitations would be a good start - I know it is not your fault BB - these are Apples restrictions - not yours. A simple table in the back of the manual detailing what is and what is not going to work on any given machine is all that is required to remedy this.
The Elephant in the Room:
So this leads us back to the elephant in the room, these "Physical Images".
You have to think to yourself, how many cases you worked that involved evidence in unallocated space, or the APFS file queue. If your answer is "lots" or you are in law enforcement where you absolutely must examine those areas on every case, then you need MQ.
However on the flip side of the coin, if you never carve unallocated space and your workflow only requires you to pull live or deleted recoverable files from within the custodian computers' file system (documents/Emails etc), then you will be paying for features that you will never use.
Ultimately the decision of what you buy is up to you, do your homework and have a free trial is the way to go, look up Tom Oldroyd at BB Sales and have a chat with him.
Would I Buy It ?
Well after spending a *long time* testing this product, I can say hand on heart, that this one is not for me. If they improved the Data Collection detection of non Apple programs then yes I would be more interested, but then the cost would, at least for me, be prohibitive.
Would I Review a New Version ?
The door is open for Cellbrite to submit the next version of MQ to CFRO for long-term review.
Who knows, they may pull out of the bag Super Vendor status and a CFRO Sizzler award next time, nobody knows !!!!
If I hear anything from BB about the new version, I'll update this review and let all you subscribers know via the newsletter!
Thanks!
I've really enjoyed writing this review, although MQ has some issues they need to sort out, I enjoyed working with it and recording my findings.
Its fair to say that I will never be caught out by an Apple machine in the near future - well until Apple make more workflow breaking changes!
Thank you for all of your support and kind messages - I enjoy reading them and reply to every one of them when time allows.
Scoring & Awards:
Category | Rating | ||
Installation | N/A | ||
Ease of Use | Average | ||
Features | Good | ||
Stability | Average | ||
Updates | Very Poor | ||
Value for Money | Poor | ||
Licencing Fairness | Excellent | ||
Documentation | Poor | ||
Support Warranty | Not Tested | ||
Summing Up:
"MQ is a very unique tool, admirable reverse engineering and significant modification to the Apple boot environment has allowed Black Bag to deliver synthesised Physical images and capture data which no other tool can produce, however you must decide if you really need that data in your production environment!"
"Once strong documentation has not aged well and now leaves the examiner stranded and scratching their head in certain scenarios - urgent long overdue updates to the user manual are required to rectify."
"A clean user interface and segregated tools allow a RAM or Disk imaging to be carried out with minimal fuss, the activity log window provides constant visual feedback of task progress."
"Infrequent program updates seem to have eroded the capabilities of the Data Collection (loose files) functionality, ubiquitous programs such as Microsoft Outlook and many others were not detected during my testing, requiring manual intervention to collect the required files."
"Whilst MQ can easily copy Disk, RAM and Logical data from your suspect machines, you must be fully aware of the limitations on these functions before you make a purchase and the extra equipment you may need as a result. My advice is speak to BB and get a free trial - so you can test MQ in your environment to make sure it meets your needs to avoid any nasty surprises."
"Lets hope they iron out the issues, radically increase the update frequency, get a handle on the documentation and make MQ great again!"
UPDATE 8th Feb 2020:
BlackBag reposted a webinar on LinkedIn which is a positive reaction to this review! It is nice to know that CFRO has an impact on vendors!
Check it out below;
Don't forget to sign up for our newsletter which will keep you up to date on new reviews (and updates to existing ones) as they are posted !
Please share this article on your social networks!
CFRO does not accept gifts, severed fingers, death threats, cash or any other form of reward for publishing a review on its website, always and forever independant warts and all reviews. Subscribe to be notified of new content.
Competition entries must be received no later than December 2019.