1. rating the ratings

Healthcare

tim-histalk
H.I.S.-tory Outline Rating the Ratings Part 1 - Intro By Vince Ciotti & Elise Ames HIS Professionals, LLC (with a lot of help from Mr. HIStalk, and many of you readers) It All Started With… We must give credit for this idea to several readers of HIStalk who posted “Readers Write” entries about rating of vendors: “From Former McKessoner: "You have to also take these ratings with a grain of salt as well (in reference to the MD Buyline rating comment). Horizon Meds Manager was #1 one year and dead last the next.” And a fascinating post by Randall Swearingen, CEO (I swear!) of Swearingen Software Inc. in Houston: “Who audits them? What independent source verifies their data to make sure it is accurate and fairly represented since they seem to have influence over some buying decisions? Answer: nobody.” This got us thinking about the many ratings of HIS systems and just how accurate they are... And Continued With… We don’t mean to slam these agencies as disreputable; indeed, Black Book earned our respect for this press release last year: “Black Book’s survey inspection of the nearly 29,000 EHR user ballots collected from Q3 2014 to Q1 2015 uncovered 33 hospital resellers casting EHR satisfaction and loyalty responses for 740 physician practices, prompting supplementary audits and an extended resurveying phase to resolve what Black Book deems intentional bias.” “It’s not Black Book’s issue that community physicians were pressured into implementing a particular EHR from their leader hospital,” said Doug Brown, Partner of Black Book. “Black Book's issue is that the hospital IT managers responsible for (re)selling and overseeing system implementations for particular EHR suites were also grading the product satisfaction and service delivery perceptions on behalf of providers they actually sold to. That is no different than soliciting a salesman to rate his own merchandise…” (italics ours) Odd how the Partner of Black Book quoted is named Doug Brown. You’d think they would have recruited the CEO of Allscripts… Which HIS Vendor is #1? There are a number of sources that rate HIS system for hospitals such as EHRs, all of which rank the leading vendors differently: And Physician Practice Vendors? As if the various ratings of the top 10 hospital systems isn’t confusing enough, consider the plethora of ratings of Physician Practice systems, of which 785 achieved ONC certification: Who Should You Believe? This rating disparity is not unique to the HIS industry; take a look at these varied rankings for the “best” sports car for 2016: Car & Driver – one of the oldest sport car magazines rated the Chevy Corvette #1. Frankly, I loved my old ones from the 1960s, but today’s don’t appeal to me as much… US News & World report – this rag rates almost everything, including hospitals & law schools (are they related?). They picked the (ugly) Porsche Boxter as #1, while the ‘vette only rated #4 Consumer Reports – who I trust the most due to no ads by vendors, although do they really know much about hot cars? They ranked the ‘vette as #13! How to Rate the Raters To evaluate the various HIS rating agencies, we’ll be covering a lot of ground in several episodes over the next few weeks, including key questions one needs to ask about their data such as: Number – how many facilities responded: 10, 50, 100? Job Class – of respondents: IT staff, clinicians, executives? Date – when were responses received: this year, past years? Size – How big or small were the facilities surveyed: Were hospitals
Please download to view
11
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Description
Text
H.I.S.-tory Outline Rating the Ratings Part 1 - Intro By Vince Ciotti & Elise Ames HIS Professionals, LLC (with a lot of help from Mr. HIStalk, and many of you readers) It All Started With… We must give credit for this idea to several readers of HIStalk who posted “Readers Write” entries about rating of vendors: “From Former McKessoner: "You have to also take these ratings with a grain of salt as well (in reference to the MD Buyline rating comment). Horizon Meds Manager was #1 one year and dead last the next.” And a fascinating post by Randall Swearingen, CEO (I swear!) of Swearingen Software Inc. in Houston: “Who audits them? What independent source verifies their data to make sure it is accurate and fairly represented since they seem to have influence over some buying decisions? Answer: nobody.” This got us thinking about the many ratings of HIS systems and just how accurate they are... And Continued With… We don’t mean to slam these agencies as disreputable; indeed, Black Book earned our respect for this press release last year: “Black Book’s survey inspection of the nearly 29,000 EHR user ballots collected from Q3 2014 to Q1 2015 uncovered 33 hospital resellers casting EHR satisfaction and loyalty responses for 740 physician practices, prompting supplementary audits and an extended resurveying phase to resolve what Black Book deems intentional bias.” “It’s not Black Book’s issue that community physicians were pressured into implementing a particular EHR from their leader hospital,” said Doug Brown, Partner of Black Book. “Black Book's issue is that the hospital IT managers responsible for (re)selling and overseeing system implementations for particular EHR suites were also grading the product satisfaction and service delivery perceptions on behalf of providers they actually sold to. That is no different than soliciting a salesman to rate his own merchandise…” (italics ours) Odd how the Partner of Black Book quoted is named Doug Brown. You’d think they would have recruited the CEO of Allscripts… Which HIS Vendor is #1? There are a number of sources that rate HIS system for hospitals such as EHRs, all of which rank the leading vendors differently: And Physician Practice Vendors? As if the various ratings of the top 10 hospital systems isn’t confusing enough, consider the plethora of ratings of Physician Practice systems, of which 785 achieved ONC certification: Who Should You Believe? This rating disparity is not unique to the HIS industry; take a look at these varied rankings for the “best” sports car for 2016: Car & Driver – one of the oldest sport car magazines rated the Chevy Corvette #1. Frankly, I loved my old ones from the 1960s, but today’s don’t appeal to me as much… US News & World report – this rag rates almost everything, including hospitals & law schools (are they related?). They picked the (ugly) Porsche Boxter as #1, while the ‘vette only rated #4 Consumer Reports – who I trust the most due to no ads by vendors, although do they really know much about hot cars? They ranked the ‘vette as #13! How to Rate the Raters To evaluate the various HIS rating agencies, we’ll be covering a lot of ground in several episodes over the next few weeks, including key questions one needs to ask about their data such as: Number – how many facilities responded: 10, 50, 100? Job Class – of respondents: IT staff, clinicians, executives? Date – when were responses received: this year, past years? Size – How big or small were the facilities surveyed: Were hospitals
Comments
Top