Primary source material is essential to the historian but they are not necessarily easily identified in the vast amounts of information available.
A good definition from the Research Users Services Association's helpful guide Primary Sources on the Web: Finding, Evaluating, Using states "Primary sources are the evidence of history, original records or objects created by participants or observers at the time historical events occurred..." [emphasis mine]
There is leeway in this definition as materials created well after the event such as oral histories or memoirs will also be considered primary source since the person who experienced the event is the one recording the oral history or writing the memoir. Just keep in mind, that the longer it has been since the event, memories become increasingly selective.
Even with primary source material, ask yourself if what you have is complete or biased in any way. If you are looking at a set of letters or a published memoir, consider how the editor or compiler made decisions about what to include. It may be certain materials were not included to portray a person or event in a certain light, material was considered irrelevant, or new evidence has come to light since the publication of the source you found.
Primary source material may be found within what appears at first glance to be a secondary source. Sometimes a secondary source item will look like a primary source. When in doubt, ask for help!