Safety and security are the most discussed topics in the aviation field. The latest security initiatives in the field of aviation propose [1I] the aircraft carriers to implement video surveillance within the aircraft at strategic locations. The current proposals allow the video surveillance data to be stored within the aircraft and monitored by one of the flight crew. The monitoring crew will be responsible for identifying the anomaly within the aircraft and take necessary preventive actions. With the introduction of additional technology within the aircraft, mere human perception may not be sufficient to make a decision. In this research work, the authors explore the possibility of implementing a smart video surveillance system (SVSS) within the aircraft that is tuned toward detecting the behavioral anomaly within the aircraft. The SVSS will generate security triggers when it detects an anomaly within the aircraft. These triggers could be combined with other triggers generated by different aircraft components (possible alarms from the flight crew, data traffic anomaly, or alarm generated by one of the avionics components) to provide a better understanding of the situation to the monitoring crew.