Login
  • Bookmark
  • PDF
  • Share
  • CaseIQ

Moore v. Publicis Groupe SA

UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF NEW YORK
Apr 25, 2012
Important Paras
Please sign up to view Important Paras.
Smart Summary (Beta)

Factual and Procedural Background

The plaintiffs, Monique Da Silva Moore et al., sued Publicis Groupe SA and MSLGroup. The parties negotiated an electronically stored information protocol ("ESI protocol") governing MSLGroup's production of ESI; the February 8, 2012 discovery conference set final parameters and Magistrate Judge Andrew J. Peck so-ordered the protocol on February 22, 2012 (Dkt. No. 92). Plaintiffs objected to Judge Peck's February 8 rulings, the ESI protocol, and his February 24, 2012 opinion and order, and filed objections under Fed. R. Civ. P. 72(a). Plaintiffs also sought Judge Peck's recusal; he denied the recusal request and allowed a formal motion, which plaintiffs filed on April 13, 2012. The district court (Judge Andrew L. Carter, Jr.) reviewed the Rule 72(a) objections and related submissions and issued this Opinion & Order on April 25, 2012.

Legal Issues Presented

  1. Whether Magistrate Judge Peck's nondispositive discovery rulings (including approval of the ESI protocol that contemplates predictive coding) should be modified or set aside as "clearly erroneous" or "contrary to law" under Fed. R. Civ. P. 72(a).
  2. Whether the predictive coding method specified in the ESI protocol lacks generally accepted reliability standards or otherwise violates Fed. R. Civ. P. 26 or Fed. R. Evid. 702.
  3. Whether Judge Peck improperly relied on outside documentary evidence or adopted MSLGroup's version of the ESI protocol on an insufficient record.
  4. Whether an evidentiary hearing was required before adopting the ESI protocol and predictive coding procedures.
  5. Whether Judge Peck's rulings concerning the production of W-2s and the timing of production of certain emails (e.g., CEO emails reserved for "Phase II") were erroneous or contrary to law.

Arguments of the Parties

Plaintiffs' Arguments

  • The predictive coding method in the ESI protocol lacks generally accepted reliability standards and is therefore unreliable.
  • Use of predictive coding violates Federal Rule of Civil Procedure 26 and Federal Rule of Evidence 702.
  • Judge Peck improperly relied on outside documentary evidence in his opinion and order and adopted MSLGroup's version of the ESI protocol on an insufficient record.
  • MSLGroup's expert is biased because the use of predictive coding will financially benefit the company.
  • Judge Peck failed to hold an evidentiary hearing before approving the predictive coding method.
  • Plaintiffs objected generally to the ESI protocol and also requested Judge Peck's recusal.

Table of Precedents Cited

Precedent Rule or Principle Cited For Application by the Court
AMBAC Fin. Servs., LLC v. Bay Area Toll Auth., No. 09 Civ. 7062, 2010 WL 4892678, at *2 (S.D.N.Y. Nov. 30, 2010) Articulates the highly deferential standard of review for magistrate judges' nondispositive orders and that reversal is appropriate only if discretion is abused. The court applied this deferential standard and concluded Judge Peck's discovery rulings are within his broad discretion and not an abuse warranting reversal.
In re Comverse Tech., Inc. Sec. Litig., No. 06 Civ. 1825, 2007 WL 680779, at *2 (E.D.N.Y. Mar. 2, 2007) Defines "contrary to law" as failing to apply or misapplying relevant statutes, case law, or rules of procedure. The court found no misapplication of statutes, case law, or rules by Judge Peck and thus his rulings were not "contrary to law."
Thomas E. Hoar, Inc. v. Sara Lee Corp., 900 F.2d 522, 525 (2d Cir. 1990) States that matters concerning discovery generally are considered nondispositive. The court treated Judge Peck's rulings as nondispositive and therefore reviewed them under the deferential Rule 72(a) standard.

Court's Reasoning and Analysis

The court began by identifying the Rule 72(a) standard: district judges must modify or set aside nondispositive magistrate orders only if they are clearly erroneous or contrary to law, a highly deferential standard. Applying that standard, the court found Judge Peck's rulings well reasoned and within his broad discretion on discovery issues.

The court reviewed the ESI protocol and noted it includes standards to measure reliability and provides plaintiffs with participation and quality-assurance mechanisms (e.g., plaintiffs may provide keywords, review documents and issue coding, raise concerns to the magistrate before final production, and revisit methods after production if relevant documents appear missing). Given these safeguards, the court held that plaintiffs' objection that predictive coding is inherently unreliable is premature and speculative at this stage.

The court addressed plaintiffs' objection to the absence of a formal evidentiary hearing, concluding that the lack of such a hearing at the February 8 conference was a minor issue and that Judge Peck remains able to order an evidentiary hearing later if the method proves unreliable. The court also compared predictive coding to manual keyword review, noting that manual review is costly and prone to human error and inconsistencies, and found no basis to deem Judge Peck's conclusion—that predictive coding as specified was more appropriate under these case circumstances—clearly erroneous or contrary to law.

On the W-2 production dispute, the court upheld Judge Peck's procedures (plaintiffs to identify missing W-2s via email within two days; MSLGroup to produce specified W-2s within three business days; further disputes to return to Judge Peck). The court also upheld Judge Peck's decision to defer production of certain CEO emails to "Phase II" without making a final determination.

Holding and Implications

The Court adopted Magistrate Judge Peck's discovery rulings and denied Plaintiffs' Rule 72(a) objections.

Direct consequences for the parties: the ESI protocol (including the predictive coding procedures contained therein) remains in effect as so-ordered; plaintiffs must follow the protocol's review and challenge procedures, and plaintiffs may identify missing W-2s by email for prompt production as directed. The court left open the possibility of revisiting the use or reliability of predictive coding if problems arise and did not find that Judge Peck's rulings set any new binding precedent beyond their application here.

Show all summary ...

Andrew L. Carter

Opinion & Order ANDREW L. CARTER, JR., United States District Judge;

Before the Court are Plaintiffs' objections, filed pursuant to Rule 72(a) of the Federal Rules of Civil Procedure, to Magistrate Judge Andrew J. Peck's rulings rendered during a February 8, 2012 discovery conference and his February 24, 2012 opinion and order (dkt. no. 96). Judge Peck's rulings and written order discussed, inter alia, the use of the predictive coding software, a computer assisted form of review. The Court assumes the parties' familiarity with the facts and the predictive coding method.

Plaintiffs and Defendant MSLGroup entered into a stipulation governing MSLGroup's production of electronically stored information ("ESI protocol"). The substance of the ESI protocol resulted from a series of court conferences and party discussions, but the February 8 conference set the final parameters for the protocol. Judge Peck so-ordered the ESI protocol on February 22, 2012. (Dkt. No. 92.) The last paragraph of the protocol provides that Plaintiffs object to the entire ESI protocol, but signed the agreement because it reflects Judge Peck's discovery rulings and Judge Peck rejected Plaintiffs' version of the ESI protocol.

Plaintiffs object to the February 8 discovery rulings, the ESI protocol, and the February 24 opinion and order, arguing, inter alia, that the predictive coding method contemplated in the ESI protocol lacks generally accepted reliability standards, that the use of such method violates Fed. R. Civ. P. 26 and Federal Rules of Evidence 702, that Judge Peck improperly relied on outside documentary evidence in his February 24 opinion and order, that MSLGroup's expert is biased because the use of the predictive coding method will reap financial benefits for the company, that Judge Peck failed to hold an evidentiary hearing, and that he adopted MSLGroup's version of the ESI protocol on an insufficient record. Plaintiffs request that the Court overturn the Magistrate Judge's rulings because they are erroneous and contrary to law. Plaintiffs also submitted a letter requesting that Judge Peck recuse himself from the action, which Judge Peck denied on April 2, 2012, but allowed them to file a formal motion. Plaintiffs filed their recusal motion on April 13, 2012, incorporating similar arguments made in their Rule 72(a) objections. (Dkt. No. 169.)

Plaintiffs filed their objections to Judge Peck's February 8 rulings on February 22, 2012 and Judge Peck issued his opinion and order on February 24, 2012. (Dkt. Nos. 93-96.) Judge Peck addressed some of Plaintiffs' objections in his opinion and order. Plaintiffs had an opportunity to respond to the written order and they submitted their reply brief on March 19, 2012. (Dkt. Nos. 123-25.)

Rule 72(a) provides that for nondispositive orders issued by a magistrate judge, "[t]he district judge in the case must consider timely objections and modify or set aside any part of the order that is clearly erroneous or is contrary to law." Fed. R. Civ. P. 72(a); see also 28 U.S.C. § 636(b)(1)(A). "Under this highly deferential standard of review, magistrates are afforded broad discretion in resolving [non-dispositive] disputes and reversal is appropriate only if their discretion is abused." AMBAC Fin. Servs., LLC v. Bay Area Toll Auth., No. 09 Civ. 7062, 2010 WL 4892678, at *2 (S.D.N.Y. Nov. 30, 2010) (citation omitted). A magistrate judge's ruling is considered "contrary to law" when it "fails to apply or misapplies relevant statutes, case law, or rules of procedure." In re Comverse Tech., Inc. Sec. Litig., No. 06 Civ. 1825, 2007 WL 680779, at *2 (E.D.N.Y. Mar. 2, 2007). "The reviewing court must be left with the definite and firm conviction that a mistake has been committed to overturn the magistrate judge's resolution of a nondispositive matter." AMBAC Fin. Servs., 2010 WL 4892678, at *2 (citation and internal quotation omitted). "Matters concerning discovery generally are considered 'nondispositive' of the litigation." Thomas E. Hoar, Inc. v. Sara Lee Corp., 900 F.2d 522, 525 (2d Cir. 1990).

Mindful of this highly deferential standard of review, the Court adopts Judge Peck's rulings because they are well reasoned and they consider the potential advantages and pitfalls of the predictive coding software. The Court has thoroughly reviewed the ESI protocol along with the parties' submissions. At the outset, the Court notes that Plaintiffs and Judge Peck disagree about the scope of Plaintiffs' acquiescence concerning the use of the method. Judge Peck's written order states that Plaintiffs have consented to its use, (Opinion and Order at 17 ("The decision to allow computer-assisted review in this case was relatively easy - the parties agreed to its use (although disagreed about how best to implement such review."))), while Plaintiffs argue that Judge Peck's order mischaracterizes their position (Pl. Reply, dated March 19, 2012, at 4-5). Nevertheless, the confusion is immaterial because the ESI protocol contains standards for measuring the reliability of the process and the protocol builds in levels of participation by Plaintiffs. It provides that the search methods will be carefully crafted and tested for quality assurance, with Plaintiffs participating in their implementation. For example, Plaintiffs' counsel may provide keywords and review the documents and the issue coding before the production is made. If there is a concern with the relevance of the culled documents, the parties may raise the issue before Judge Peck before the final production. Further, upon the receipt of the production, if Plaintiffs determine that they are missing relevant documents, they may revisit the issue of whether the software is the best method. At this stage, there is insufficient evidence to conclude that the use of the predictive coding software will deny Plaintiffs access to liberal discovery.

The predictive coding method is provided in pages 10-18 of the ESI protocol. (Dkt. No. 92.)

Plaintiffs' arguments concerning the reliability of the method are also premature. It is difficult to ascertain that the predictive software is less reliable than the traditional keyword search. Experts were present during the February 8 conference and Judge Peck heard from these experts. The lack of a formal evidentiary hearing at the conference is a minor issue because if the method appears unreliable as the litigation continues and the parties continue to dispute its effectiveness, the Magistrate Judge may then conduct an evidentiary hearing. Judge Peck is in the best position to determine when and if an evidentiary hearing is required and the exercise of his discretion is not contrary to law. Judge Peck has ruled that if the predictive coding software is flawed or if Plaintiffs are not receiving the types of documents that should be produced, the parties are allowed to reconsider their methods and raise their concerns with the Magistrate Judge. The Court understands that the majority of documentary evidence has to be produced by MSLGroup and that Plaintiffs do not have many documents of their own. If the method provided in the protocol does not work or if the sample size is indeed too small to properly apply the technology, the Court will not preclude Plaintiffs from receiving relevant information, but to call the method unreliable at this stage is speculative.

The Court adopts Judge Peck's analysis of Rule 26(g) and Fed. R. Evidence 702 for similar reasons provided in his written opinion.
--------

There simply is no review tool that guarantees perfection. The parties and Judge Peck have acknowledged that there are risks inherent in any method of reviewing electronic documents. Manual review with keyword searches is costly, though appropriate in certain situations. However, even if all parties here were willing to entertain the notion of manually reviewing the documents, such review is prone to human error and marred with inconsistencies from the various attorneys' determination of whether a document is responsive. Judge Peck concluded that under the circumstances of this particular case, the use of the predictive coding software as specified in the ESI protocol is more appropriate than keyword searching. The Court does not find a basis to hold that his conclusion is clearly erroneous or contrary to law. Thus, Judge Peck's orders are adopted and Plaintiffs' objections are denied.

The Court also concludes that it should not reject Judge Peck's rulings concerning the production of W-2s. Judge Peck previously ruled that Plaintiffs may visit defense counsel's office and identify the W-2s they want. He also quashed Plaintiffs' third-party subpoena on Automatic Data Processing Services. Plaintiffs and MSLGroup dispute whether the W-2s that Plaintiffs identified have actually been produced. (Compare PL Reply at 10 with Def. Opp. at 25.) To the extent that Plaintiffs are missing the W-2s that they identified to MSLGroup, the Court instructs them to send MSLGroup an email noting the missing W-2s within two days of this order. MSLGroup should produce those specified W-2s within three business days of Plaintiffs' email. If there are additional disputes about the missing W-2s, they should return to Judge Peck. Further, Judge Peck's decision to delay production of emails from MSLGroup's chief executive officer until "Phase II" of the ESI protocol is not erroneous or contrary to law. Judge Peck did not make a final determination about whether MSLGroup should produce those emails. The Court reminds the parties that it affords Judge Peck's non-dispositive rulings great deference and that magistrate judges generally have broad latitude with respect to discovery issues. Dated: New York, New York


April 25, 2012
SO ORDERED.

__________________


Andrew L. Carter, Jr.


United States District Judge