Shivam Kundan

Shivam KundanShivam KundanShivam Kundan

Shivam Kundan

Shivam KundanShivam KundanShivam Kundan
  • Home
  • Resume
  • Projects
  • Publications
  • More
    • Home
    • Resume
    • Projects
    • Publications
  • Sign In
  • Create Account

  • My Account
  • Signed in as:

  • filler@godaddy.com


  • My Account
  • Sign out


Signed in as:

filler@godaddy.com

  • Home
  • Resume
  • Projects
  • Publications

Account


  • My Account
  • Sign out


  • Sign In
  • My Account
Back

introduction

What is a tricorder?

A tricorder is a portable sensing / scanning device first featured in the science-fiction TV series Star Trek (1967), which is set roughly 200 years into future. It follows humanity's first forays into deep space, exploring strange new worlds and meeting new life and new civilizations.


When visiting an uncharted planet, the protagonists want to measure several quantities such as the composition of the atmosphere, levels of ambient radiation, element in the soil, and scattering of light in the sky (and whatever else the episode's plot requires). To enable this scientific exploration, the aim of the tricorder device is to sense as many physical quantities as technologically possible in a handheld, battery-operated form factor. 


Tricorders have been depicted in three broad categories: medical, scientific, and engineering. This project deals with the scientific and engineering versions.

Why make a tricorder?

  • Better understand embedded systems. I am especially fascinated by the interaction between hardware and software. 


  • I like to measure things (for not necessarily any specific reason).


  • I can't buy one at the store, so the alternative is to make one (more about this in the following paragraphs).


  • Become the ultimate Star Trek fan.

What makes this the most advanced tricorder?

A few things make this particular implementation stand out:


  • Sensing ability: The number of physical quantities it can measure, which is more than any project made before Detailed info ⎋


  • Ease of use: Designed with the principle "If you can use a smart phone, you can use this tricorder". Uses the same intuitive touch functions (like swiping) and display elements (like icons) that are common in smartphone interfaces. There are only two fixed buttons: a "home"/"back" button and another that shows a "quick menu" which can be used for functions like taking screenshots, adjusting display brightness, or telling the device to go to sleep. These buttons are embedded within the LCARS graphics, and everything else is context specific. There is also the top bar which shows time and device stats like wifi name, display brightness, and battery percentage. It can be woken from sleep by touching the capacitive touch screen.


  • Graphics hardware: As best as I can tell, this design has the highest density display ever put into a functioning tricorder project. Stats: 60 FPS max frame rate, ~254 pixels per inch,  720x720 px resolution,  18-bit color (!), 4.0" screen size, and a quirky square shape (Hyperpixel 4.0 Square w/ Touch). Uses the high-speed DPI interface for communication, instead of the slower and more common SPI interface. 


  • Visualization quality: All real-time sensor readings are presented visually, many with customizable visualization options. Carefully coordinated color schemes and transparency make it significantly less of an eye-sore than previous UI designs. Other fine details, like anti-aliasing the shapes and using hardware-assisted frame buffering also improve the experience. Plotting is done mainly by using matplotlib and seaborn, which are the same libraries used for visualizing academic/scientific research. 


  • Independently usable modules: The sensor module can be used independently in a pinch, or whenever I don't care about visualization. It has its own battery (2,500 mAh LiPo), two OLED screens (128x64), and four capacitive touch pads that allow menu navigation like using arrow keys on a keyboard. The battery can be charged while simultaneously being used by the Raspberry Pi, either by direct USB connection or separately by a wall outlet (Bluetooth). The Raspberry Pi portion handles the optical (IR) camera, Software Defined Radio (SDR), and data visualization. It has its own battery (10,000 mAh) with pass-through charging so it can be recharged while using the Pi.

Why is my smartphone not a tricorder?

Since there is no conclusive definition for what makes a real-world tricorder, a reasonable assumption made by the casual observer is that modern smartphones are equivalent to current-day scientific tricorders. In some ways this is actually true, since a smartphone is essentially a portable, general-purpose computer, chock full of sensors such as accelerometers, magnetometers, barometers, LiDAR (iPhones), and the usual mics & cameras. Combined with good software, these sensors allow for a convenient and engaging user experience for day-to-day activities.


However, what smartphones cannot tell us (so far) is the environmental conditions in our immediate vicinity such as air quality, concentration of gasses, temperature, and humidity. It could connect to the internet and retrieve data from several sources but this presents two problems:

  1. The temperature (for example) in your room is not necessarily the same as the temperature in your city. The same applies for other quantities such as air quality, CO2 concentration, UV light, etc.
  2. The internet is not available everywhere, especially not in unexplored frontiers. 


Therefore, a real tricorder should be able to sense, visualize, and analyze data regardless of external communication (and computing) being available. Ideally, it is a self-contained, self-sufficient*, and completely untethered piece of equipment. However, when external communication is available, it should be able to upload backups, share data, or be used as part of a larger system (IoT).


(* apart from the battery/energy source being replenished)

Why don't phone manufacturers just make a separate device?

These are just my educated guesses, since I'm not an economist or scientist:


  • I suspect not enough people are interested in amateur measurement and exploration to justify the cost of R&D  and/or manufacturing. A mass-market product can't be cheap until large numbers of units are produced, but this is only possible if many people buy it in the first place. In this situation, economies of scale cannot be adequately established and the profitability (ultimate goal for companies) will remain questionable. This seems to be a version of the inventor's paradox.


  • For any serious scientific/industrial measurement, it would be easier and almost certainly more accurate to just use separate devices such as range finders, microphones, thermal cameras, etc. In an integrated device, the sensors can (and do) interfere with each other and with the components of the device itself. For example, smartphones generally cannot tell you the temperature in your room because the heat from its internal components interferes with accurate measurement. Another example is smart watches not being able to determine accurate compass heading if the user is wearing a magnetic wristband. Work-arounds to such problems could probably be developed, but most buyers would not appreciate the added cost for something they don't really care about, and quite often don't want to care about.

Why make a tricorder (part 2)?

Given the context of the previous two answers: 

Because I can't buy one at the store. Luckily, I am almost finished with my PhD in embedded systems so I figured I'll give it a shot, use the skills I learned in class and research, and hopefully learn some new things along the way.

What have you learned so far?

A lot more than I had expected.


The technical side:

Making GUIs, working with vector graphics, designing (and procuring) PCBs, powering circuits with batteries, Bluetooth and BLE communication, standardized Human Interface Devices (HID) communication, standardized GPS communication, history and theory of measurement, to name just a few. A renewed appreciation for how integrated and monolithic the design of portable computers is (after much thinking, I concluded that a monolith is the most practical shape for this device). 


The human side:

During the course of testing (or bragging), I showed this device to a number of people from different walks of life, having different educational backgrounds and interests, and having varying levels of curiosity about technology. Some of the things I learned:

  1. Surprisingly few people know that white light is actually made up of equal proportions of the visible colors, each with their own distinct wavelengths. Even more surprised to learn this is ultimately why the sky is blue and stop signs are red.
  2. Even fewer people know what temperature really is (vibration of atoms), or that it is differs from one spot to another even if the spots are physically close.
  3. Not everyone knows that normal glass blocks UV light. 
  4. Barometric pressure increases before it rains (this was new to me too) and then settles back down to an equilibrium level determined by one's elevation above mean sea level. Additionally, this information can be combined with relative humidity readings to determine the absolute humidity of the air, i.e. how many grams of water are present in each m^3 of my air.


When will the design be finished?

When I first started, I was hoping to have a pocket device that could answer my everyday questions like:

  1. Is it actually cold in this room? Or am I just feeling cold?
  2. How much sunlight does my room receive at different times of day and month?
  3. The various brightness settings on my TV: How much brighter is the "dark" setting than the "darkest" setting? 10%? 10,000%?
  4. How clean is the air in my apartment? Or in the airplane I am flying in? Or the hotel I'm staying at?
  5. What is the airspeed velocity of an unladen swallow? 


In short, I'll consider the design finished when it is small enough to fit into my pocket and I can pull it out to measure things, answer questions, and satisfy my curiosity at whim.

Next: HistoryBack to main

Powered by

  • Home
  • Resume
  • Projects
  • Publications