The ORS is the Occupational Requirements Survey (www.bls.gov/ors). It is fully funded by the Social Security Administration (SSA), but data is collected by the Bureau of Labor Statistics (BLS), more specifically by a significant group of economists within the National Compensation Survey program. In 2013, SSA began funding BLS/NCS/ORS to see if they could collect data at the SOC level from employers regarding many different factors that are not presently tied to the SOC (other than self-reported incumbent data in the O*NET program). The data collection effort was an outgrowth of the OIDAP (Occupational Information Development Advisory Panel - www.ssa.gov/oidap) efforts from late 2008 to mid 2012. Many of the OIDAP recommendations called for improved factors for data collection. This is the original source of the many additional factors, particularly for Physical Conditions and Environmental factors. Unfortunately, the OIDAP panel had not completed its work on Mental/Cognitive factors prior to its dissolution in 2012.
SSA contracted with BLS/NCS for 3 years (2013-2015) to see "if" they could collect this kind of data at the SOC level. The conclusion was "of course we can", so actual data collection began in 2016. The "First Wave" data collection ended in 2018, with publication of some of the early data in 2017, 2018, and the final set in 2019. Because of wording problems in their first wave definition of many of the mental/cognitive factors and their sampling strategy, they did not obtain enough data to reliably report in this group for the these factors. They have reworded their data collection instruments and modified their sampling strategy, and they are now getting sufficient data to report in their "second wave" data collection effort. Here is their history article: www.bls.gov/opub/hom/ors/history.htm
Here is their list of what they collect and report: www.bls.gov/opub/hom/ors/calculation.htm
Think of their Data Collection Manual as the new Revised Handbook for Analyzing Jobs. Available here: www.bls.gov/ors/information-for-survey-participants/pdf/...
As an alternative to the cumbersome BLS data reporting tool, SkillTRAN began reporting the final first wave data set in 2019 in its web-based products. In the Job Browser Pro PC, we have added a web-based hyperlink from the PC version to the web page containing this 2018 "final first wave data". This data set covers 347 unique SOC codes. Not all data elements are reported for every occupation. This covers about 83% of the labor force. A "Second Wave" data collection effort lasting 5 years is conmpleted, with revised data definitions for 477 unique SOC groups, with many reporting the revised mental/cognitive factors. When you visit the ORS site directly and request data from their data reporting tool, you can now get both the 2018 Final First Wave data and the Final Second Wave (2019-2023) data.
ORS data is reported in a variety of ways differently from how we are used to seeing it in the DOT. There is a higher level of precision, with the average value (or band estimate) reported first, then the Standard Error of Measurement (SEM). Before your eyes roll to the back of your head, just multiply the value reported x the reported SEM. The result is what you can add or subtract from the reported value to be confident that 2/3 of the reported value fall within that range (68% confidence interval). If you want to be 95% confident, multiply the SEM x 2, then add or subtract that bigger range for 95% confidence.
Example: 51-9061 Inspectors, Testers, Samplers, and Weighers
Hours of Sitting, mean Value = 2.8 hours SEM = .26 hours
Interpretation:
68% Confidence - Employers report that employees sit between 2.54 hours and 3.06 hours per day (+/- .26 SEM)
95% Confidence - Employers report that employees sit between 2.28 hours and 3.32 hours per day (+/- .52 SEM)
BLS reports data the way that any statistical organization does - with lots of math and careful collection. They ask employers to report this information "off the cuff", with few actual time studies of workers nor on the job observation. Further, the data is collected at the SOC group level, so this data reflects typically more than one specific occupation. This example above includes a whopping 782 DOT occupations!
The challenge we face as consumers/users of this rich new data set is how to incorporate this into our daily work/testimony. It should start by first getting familiar with their new/revised data definitions - contained in their Data Collection Manual. Here is a shorter starting point: www.bls.gov/opub/hom/ors/pdf/ors.pdf
BLS collects and reports the data. How/when SSA elects to further aggregate/condense some of these factors remains to be determined. SSA is building some kind of Vocational Information Tool (VIT), but very little has been shared about what it actually does or will do. The overall data collection effort certainly points towards SSA's desire to move from the DOT level of detail to SOC groups of data. But how this will be implemented in SSA decision making/claims adjudication is undisclosed and will require major policy revisions.
In early 2024, ORS released its Final Second Wave data. Its current web-based data tool uses only this data set (for 477 SOC occupations). SkillTRAN now displays both 2018 and 2023 data sources side by side as reported by the ORS program to incorporate both 2018 final and 2023 Final Second Wave data side by side. You can look forward to more values and SEM calculations! A third wave 5 year data collection will last from FFY 2024-2028 which will include several additional mental-cognitive items in addition to what is collected now.
Click here for a 1 minute quick video about the new ORS data in many SkillTRAN products.
The more you read about ORS, the more you will understand about it. If you plan to use it, study up - hyperlinks above!
NOTE: SkillTRAN Public Comments to ORS: https://skilltran.com/index.php/customers/industry-news/149-ors/209-skilltran-ors
