{"id":2485,"date":"2020-01-04T16:19:59","date_gmt":"2020-01-04T21:19:59","guid":{"rendered":"https:\/\/www2.law.temple.edu\/aer\/?p=2485"},"modified":"2021-12-16T14:56:57","modified_gmt":"2021-12-16T14:56:57","slug":"flakey-experts","status":"publish","type":"post","link":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/","title":{"rendered":"“Flakey” Experts"},"content":{"rendered":"

How do we assess the expert we consult, the one we hire and proffer, or the expert we will be confronting?\u00a0 If it is the opposing expert there will be a deposition (in a civil case) and testimony from prior cases as well as intelligence gathering from attorneys in your field who have faced the same witness.\u00a0 If it is your expert it is prior experience, the recommendation of colleagues, and possibly a matter of cost and availability.<\/p>\n

Regardless of which side the expert is on, it is the curriculum vitae<\/em> that will be key in the initially evaluating the witness\u2019 bona fides<\/em>.\u00a0 But CVs are more than skin deep \u2013 and three issues may be lurking beneath the surface that require assessment.<\/p>\n

The first is the witness\u2019 list of publications.\u00a0 Multiple concerns arise here.\u00a0 A claim that a publication is \u201cpeer reviewed\u201d is meaningless unless assessed by two criteria \u2013 who are the peers and is the review \u201c double blind?\u201d\u00a0 The criticism leveled in a recent court decision regarding firearm experts explains the concerns:<\/p>\n

The\u2026peer<\/strong> review process itself is “open,” meaning that both the author and reviewer know the other’s identity and may contact each other during the review process\u2026This open process seems highly unusual for the publication of empirical scientific research\u2026 The practice of double-blind peer<\/strong> review, by contrast, constitutes the standard among scientific publications and guards against personal and institutional biases by shielding both reviewer and author from the identity of the other\u2026Use of a so-called “open” process diminishes the extent to which proponents of firearms and toolmark identification evidence can claim that its articles have been subjected to meaningful, stringent peer<\/strong> review.<\/p>\n

\u2026[U]nlike other scientific journals, the AFTE Journal<\/em> is not more broadly available and cannot even be obtained in university libraries. Id.<\/em> 18:11-13. Such restricted access effectively forecloses the type of review of the journal’s publications by a wider community of scientists, academics, and other interested parties that could serve as an important mechanism for quality assurance.<\/p>\n

\u2026<\/p>\n

[G]enerally limiting the review of its publications and making them available only to its members or others who pay[] avoids the scrutiny of scientists and academics outside the field of firearms and toolmark analysis. Third, the very nature of AFTE impacts the meaningfulness of \u2026[T]hose who review the\u2026articles may be trained and experienced in the field of firearms and toolmark examination, but do not necessarily have any specialized or even relevant training in research design and methodology. Perhaps more importantly, members of the\u2026editorial board\u2014those who review its articles prior to publication\u2014have a vested, career-based interest in publishing studies that validate their own field and methodologies.<\/p>\n

United States v. Tibbs<\/u>, 2019 D.C. Super. LEXIS 9, *29-35.<\/p>\n

Separate from peer review is the quality of the journal itself.\u00a0 Professor David Kaye has developed a blog tracking questionable scientific journals \u2013 in one post he dissects the invitation to publish offered by one with an impressive name:<\/p>\n

JScholar<\/a>‘s Journal of Forensic Research and Crime Studies (JFRCS) promises “maintaining rigorous peer-review process.” A competent academic journal would use referees to suggest improvements in most articles they recommend for acceptance, but the JFRCS reviewers need not spend much time on that because “All accepted papers will be appeared online immediately” and online is the only mode of publication. Instant publication also helps lighten the editors’ workload.<\/p>\n

Kaye notes an additional attribute: \u201cThe cost for the privilege of having work posted in this journal is $777.\u201d\u00a0 http:\/\/flakyj.blogspot.com\/<\/a> (last visited November 30, 2019).\u00a0 So the lessons for a list of \u201cimpressive\u201d publications is to read on \u2013 assess who the reviewers are, whether they are blinded, and if you the attorney can also pay for the privilege of publishing in that same journal.<\/p>\n

Pay for play applies not only to journals but to organization membership and certification.\u00a0 The infamous story is that of the American College of Forensic Examiners Institute, which permits one to receive a certificate as a Certified Forensic Consultant upon payment of a fee and passing an online multiple choice exam.\u00a0 Among those with this impressive credential is a house cat, registered by its owner.\u00a0 https:\/\/www.pbs.org\/wgbh\/frontline\/article\/no-forensic-background-no-problem\/<\/a> (last visited November 30, 2019).\u00a0 The lesson here \u2013 see how easy it is for you, the non-scientist or non-engineer lawyer \u2013 to become a member of the organization and thereafter be credentialed.<\/p>\n

The third consideration in weighing the expert’s strengths involves “proficiency tests.”\u00a0 In many fields, analysts are required to take periodic tests to assess “proficiency” – the ability to perform tasks in the discipline.\u00a0 The problem here is simple – sometimes the stringency [difficulty level] of those tests is quite low, resulting in easy success and perfect scores.<\/p>\n

In the just-published report “Fingerprint Analysis Is High-Stakes Work — But It Doesn’t Take Much To Qualify As An Expert,” the INTERCEPT reports of three public defendens who paid for and took the proficiency test taken by latent print examiners.\u00a0 https:\/\/theintercept.com\/2019\/11\/29\/fingerprint-examination-proficiency-test-forensic-science\/<\/a>\u00a0 Each had a near-perfect score,\u00a0 11 out of 12.\u00a0 “Each of them had correctly identified all but one of the fingerprints contained in the test.”\u00a0 The lesson here?\u00a0 A proficiency test is only as meaningful as its level of difficulty – but that can’t be ascertained without taking it yourself or finding reports confirming how easy the particular test is.<\/p>\n

We need and value experts — but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.<\/p>\n

<\/h1>\n

<\/h1>\n","protected":false},"excerpt":{"rendered":"

How do we assess the expert we consult, the one we hire and proffer, or the expert we will be confronting?\u00a0 If it is the opposing expert there will be a deposition (in a civil case) and testimony from prior cases as well as intelligence gathering from attorneys in your field who have faced the<\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,6,7,11],"tags":[],"coauthors":[238],"class_list":["post-2485","post","type-post","status-publish","format-standard","hentry","category-advocacy-and-evidence-blog","category-criminal-law","category-evidence","category-trial-advocacy"],"yoast_head":"\n"Flakey" Experts - Advocacy and Evidence Resources<\/title>\n<meta name=\"description\" content=\"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\""Flakey" Experts - Advocacy and Evidence Resources\" \/>\n<meta property=\"og:description\" content=\"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\" \/>\n<meta property=\"og:site_name\" content=\"Advocacy and Evidence Resources\" \/>\n<meta property=\"article:published_time\" content=\"2020-01-04T21:19:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-12-16T14:56:57+00:00\" \/>\n<meta name=\"author\" content=\"Jules M Epstein (hehimhis)\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jules M Epstein (hehimhis)\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\"},\"author\":{\"name\":\"Jules M Epstein (hehimhis)\",\"@id\":\"https:\/\/law.temple.edu\/aer\/#\/schema\/person\/ebe47f403ad14e2c5faec834f2d8472e\"},\"headline\":\"“Flakey” Experts\",\"datePublished\":\"2020-01-04T21:19:59+00:00\",\"dateModified\":\"2021-12-16T14:56:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\"},\"wordCount\":918,\"publisher\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/#organization\"},\"articleSection\":[\"Advocacy and Evidence Blog\",\"Criminal Law\",\"Evidence\",\"Trial Advocacy\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\",\"url\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\",\"name\":\"\\\"Flakey\\\" Experts - Advocacy and Evidence Resources\",\"isPartOf\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/#website\"},\"datePublished\":\"2020-01-04T21:19:59+00:00\",\"dateModified\":\"2021-12-16T14:56:57+00:00\",\"description\":\"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.\",\"breadcrumb\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/law.temple.edu\/aer\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"“Flakey” Experts\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/law.temple.edu\/aer\/#website\",\"url\":\"https:\/\/law.temple.edu\/aer\/\",\"name\":\"Advocacy and Evidence Resources\",\"description\":\"Just another Law Sites site\",\"publisher\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/law.temple.edu\/aer\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/law.temple.edu\/aer\/#organization\",\"name\":\"Advocacy and Evidence Resources\",\"url\":\"https:\/\/law.temple.edu\/aer\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/law.temple.edu\/aer\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/law.temple.edu\/aer\/wp-content\/uploads\/sites\/5\/2021\/07\/AER-LOGO.png\",\"contentUrl\":\"https:\/\/law.temple.edu\/aer\/wp-content\/uploads\/sites\/5\/2021\/07\/AER-LOGO.png\",\"width\":711,\"height\":220,\"caption\":\"Advocacy and Evidence Resources\"},\"image\":{\"@id\":\"https:\/\/law.temple.edu\/aer\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/law.temple.edu\/aer\/#\/schema\/person\/ebe47f403ad14e2c5faec834f2d8472e\",\"name\":\"Jules M Epstein (hehimhis)\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g6b68adb939ecac32ef61d8026f0bafe4\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g\",\"caption\":\"Jules M Epstein (hehimhis)\"},\"url\":\"https:\/\/law.temple.edu\/aer\/author\/tug27334\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\"Flakey\" Experts - Advocacy and Evidence Resources","description":"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/","og_locale":"en_US","og_type":"article","og_title":"\"Flakey\" Experts - Advocacy and Evidence Resources","og_description":"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.","og_url":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/","og_site_name":"Advocacy and Evidence Resources","article_published_time":"2020-01-04T21:19:59+00:00","article_modified_time":"2021-12-16T14:56:57+00:00","author":"Jules M Epstein (hehimhis)","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jules M Epstein (hehimhis)","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#article","isPartOf":{"@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/"},"author":{"name":"Jules M Epstein (hehimhis)","@id":"https:\/\/law.temple.edu\/aer\/#\/schema\/person\/ebe47f403ad14e2c5faec834f2d8472e"},"headline":"“Flakey” Experts","datePublished":"2020-01-04T21:19:59+00:00","dateModified":"2021-12-16T14:56:57+00:00","mainEntityOfPage":{"@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/"},"wordCount":918,"publisher":{"@id":"https:\/\/law.temple.edu\/aer\/#organization"},"articleSection":["Advocacy and Evidence Blog","Criminal Law","Evidence","Trial Advocacy"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/","url":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/","name":"\"Flakey\" Experts - Advocacy and Evidence Resources","isPartOf":{"@id":"https:\/\/law.temple.edu\/aer\/#website"},"datePublished":"2020-01-04T21:19:59+00:00","dateModified":"2021-12-16T14:56:57+00:00","description":"We need and value experts -- but lawyers vetting those witnesses need to become expert in reading between and behind the lines of a C.V.","breadcrumb":{"@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/law.temple.edu\/aer\/2020\/01\/04\/flakey-experts\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/law.temple.edu\/aer\/"},{"@type":"ListItem","position":2,"name":"“Flakey” Experts"}]},{"@type":"WebSite","@id":"https:\/\/law.temple.edu\/aer\/#website","url":"https:\/\/law.temple.edu\/aer\/","name":"Advocacy and Evidence Resources","description":"Just another Law Sites site","publisher":{"@id":"https:\/\/law.temple.edu\/aer\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/law.temple.edu\/aer\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/law.temple.edu\/aer\/#organization","name":"Advocacy and Evidence Resources","url":"https:\/\/law.temple.edu\/aer\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/law.temple.edu\/aer\/#\/schema\/logo\/image\/","url":"https:\/\/law.temple.edu\/aer\/wp-content\/uploads\/sites\/5\/2021\/07\/AER-LOGO.png","contentUrl":"https:\/\/law.temple.edu\/aer\/wp-content\/uploads\/sites\/5\/2021\/07\/AER-LOGO.png","width":711,"height":220,"caption":"Advocacy and Evidence Resources"},"image":{"@id":"https:\/\/law.temple.edu\/aer\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/law.temple.edu\/aer\/#\/schema\/person\/ebe47f403ad14e2c5faec834f2d8472e","name":"Jules M Epstein (hehimhis)","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g6b68adb939ecac32ef61d8026f0bafe4","url":"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d2a56b84151f5331c5c999af7a12cc505aeed9fec929142bc9dd30b398301e5b?s=96&d=mm&r=g","caption":"Jules M Epstein (hehimhis)"},"url":"https:\/\/law.temple.edu\/aer\/author\/tug27334\/"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/posts\/2485","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/comments?post=2485"}],"version-history":[{"count":1,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/posts\/2485\/revisions"}],"predecessor-version":[{"id":3359,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/posts\/2485\/revisions\/3359"}],"wp:attachment":[{"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/media?parent=2485"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/categories?post=2485"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/tags?post=2485"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/law.temple.edu\/aer\/wp-json\/wp\/v2\/coauthors?post=2485"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}