Background: Studies comparing self-report substance use data to biochemical verification generally demonstrate high rates of concordance. We argue that these rates are due to the relatively high true negative rate in the general population, and high degree of honestly in treatment seeking individuals. We hypothesized that high risk individuals not seeking treatment would demonstrate low concordance and a high false negative rate of self-reported substance use. Methods: A sample of 500 individuals from a smoking cessation clinical trial was assessed over 1 year. Assessments included semi-structured interviews, questionnaires (e.g. Addiction Severity Index, etc.), and urine drug screen assays (UDS). Generalized estimating equations (GEES) were used to predict false negative reports for various substances across the study and determine the influence of substance use on the primary study outcome of smoking cessation. Results: Participants demonstrated high false negative rates in reporting substances use, and the false negative rates increased as the study progressed. Established predictors of false negatives generalized to the current sample. High concordance and low false negative rates were found in self-report of nicotine use. A small but significant relationship was found in for effect of biochemically verified substance use on smoking cessation. Conclusions: Biochemical verification of substance use is needed in high risk populations involved in studies not directly related to the treatment of substance use, especially in populations with high threat of stigmatization. Testing should continue through the time period of the study for maximal identification of substance use.