Files
rtabmap/corelib/test/test_rtabmap_integration.cpp

2436 lines
108 KiB
C++
Raw Normal View History

Adding doc and tests (#1492) * added doc and tests for util2d.h * updated cmake-ros ci * Added util3d.h doc and tests * util3d_transforms.h: Added doc and tests * util3d_filtering.h: started doc and test * util3d_filtering.h: more tests and doc * Added more doc/tests * finished util3d_filtering doc and tests * added test for util2d::depthBleedingFiltering * Added util3d_registration tests * Added util3d_features.h doc/tests * added doc/tests for util3d_correspondences.h * added doc/gtest for util3d_mapping.h (missing hpp functions) * finished testing util3d_mapping.hpp * Added util3d_motion_estimation.h tests (2D->3D done) * finished util3d_motion_estimation.h tests * minimal util3d_surface.h * Added Transform and VisualWord tests * Added doc for CameraModel and StereoCameraModel * Added more logs in ros ci * Passing tests on fical * improved all devcontainer * added devcontainer kilted, fixed source setup.bash, removed ldconfig in ros-cmake workflow * cleanup * source ros * Added utilite tests * Added testing to appveyor, github actions cancellable on re-commit on same branch * appveyor testing without all targets * appveyor: specifying ALL_BUILD target * Fixed Util2dTest.NMSImageBoundsRespected test * Fixing PCL Indices error on old pcl * Added VWDictionary tests and doc. Fixed LSH not working (fix from https://github.com/flann-lib/flann/pull/472 * fixing some appveyor CI errors, added test to check dictionary serialization against all type * Added StereoDense, StereoBM and StereoSGBM doc and tests * Added Stereo tests * Added CameraModel and StereoCameraModel tests * Added doc and test for Statistics * Added doc/tests for Signature * Added doc/test for SensorEvent, added doc for SensorCaptureInfo * Added doc to SensorData * Added SensorData tests * Added SensorCapture and SensorCaptureThread doc and tests * fixed sensordata test * updated SSC test and doc * Added doc and tests for BayesFilter class * Enabled testing on mac, updated windows testing like on linux * added test_link * fixed unresolved on windows * fixed ThreadHandle error on macos ci * Added GPS and GeodeticCoords tests * Added tests for compression * Added Odometry tests (base class only) * Added DBDriver tests * Added coverage report * uniformized test names * fixing concurancy and coverage ci * dont built tools, examples and app for coverage build * fixed report tool rebuilt without qt compilation error * updated coverage option * updated coverage config * added doc CI job * fixing windows and mac ci errors * Added DBDriverSqlite3 tests * Added IMU tests * Added Graph tests * fixing flaky macos test * Added IMUThread and IMUFilter tests * Added Landmarks tests * Added LASWriter tests * fixing seed flaky test * fixing flaky macos timing tests * Added LocalGrid tests * Added LocalGridMaker tests * fixing ci errors * Added GlobalMap tests * Added doc for EnvSensor * Added Features2D tests * Added Registration tests * Added RegistrationVis tests * Added doc for Rtabmap and Memory classes * Added Memory and Rtabmap tests * making some tests less flaky * lcov 1.14 support * updated compatible tool arguments * Added integration tests (RGB-D, Stereo, Lidar2d, Lidar3d) * More octomap checks * Refactored how/when python interpretor is created to simplify library usage * Added python tests * fixed some flaky tests * suppressed some third party related warnings * fixed ceres tests * more flaky fixes * Fixing tests without libpointmatcher * Added RANSAC rejection filter to PCL ICP * fixing multi platform flakiness * Added test to detect regression * Fixing windows pcl link error * fixed some macos flakiness * bigger 2D2D registration error on opencv 4.6.0 * flakiness * fixing flaky tests on windows and mac * flaky thread test on slow mac VM * windows slow test * fixing more ci erros * fxing temp dir on windows * Added Optimizer tests and discovered some bugs (fixed) * fixing flaky tests in mac and windows * Added Optimizer doc * Added GTSAM BA, updated Ceres to use g2o ba parameters. Renamed g2o's ba related parameters to Optimizer group and used by both gtsam and ceres. * fixing build without gtsam * fixing home dir * fixing python ci isssues * Added multicam ba tests * Added Ceres multicam BA support * Aligned BundleAdjustment parameters with Optimizer/Strategy to avoid confusion in the code * Added BA integration test * Added robust graph optimization integration test * Added loop3it test * Added stereo20Hz test * Added smartfactor gtsam * Fixed bugged check and warn if python didn't return any descriptors * Fixing gtsam version build issues * fixing tilt on windows ci * loosing ceres integration test for ci * mac ci flakiness * updating missing param in gui * updating test bound for mac * added appearance-based tests, set min gftt quality to quality level * testing more stuff * improving features2d tests * ci flakiness * fixing flaky ci * ci fixes * flaky fixes * Added RegistrationIcp tests * Added icp integration test with real-worl corridor like env * intermediate nodes * fixing enum * Updated test to catch #1714 * Fixed 2d corridor failing on pcl * flaky pnp test * flaky brisk test * Set rtabmap_integration test as long * updating loop closure test * flaky ci tests * TEsting roundtrip g2o/toro save/load * loosing test bound * fixed cuda capable checks * flaky tests * Debugging test hanging * more debugging stuff * updating limit * windows: disabled cuda on ci to avoid incompatible driver issue. Fixing a bad test mem allocation * trying fixing cuda hanging issue * fixing ci flakyness * flaky tests * Updated BOW flaky tests by checking min precision/recall instead of recall@100precision. Fixed signature test * CameraModel::load() test initRectificationMap param * test dbdriver load dictionary idsOnly * Memory: test keepLinkedInDb param * added dummyDictionary tests * test intermediate nodes count * Added MarkerDetector tests * reverted breaking change of UMutex and USemaphore * Features2d: fixed compiltion warnings with clang about override * clang warnings * fixing test build with pcl 1.8 * g2o and gtsam build errors on android * opencv5 test fixes * disabled testing for ios and android builds * normalized endline characters for easier diff * added LF CRLF rule * bump 0.23.10. fixing doc version * Publish rtabmap website doc from ci * fixing MSCVC build error * macos icp flaky test * fixing ceres macos test bound * ficing more flaky tests * fixing opencv5 related test errors. Also fixed an actual bug in ENU_WGS84ToGeocentric_WGS84() * added comment about mrpt change * removed rosdoc2 (will add it for rtabmap_ros later) * fixing website style * updated download links * locally deployable website with api * sweep doxygen issues * improved/revised doxygen main pages * removed examples empty page * Updated doxygen style * more concise doxygen groups * added api link on main readme * fixing utilite test error * fixing CommonFilteringGroundNormalsUp test * updated precisionRecall test bounds for Freak and brief descriptors * fixing scale check in ba tests * disabled tests on windows cuda build (missing dlls amd runner cannot test cuda anyway) * ceres: missing suitesparse dep in windows ci * adjusting recall thr for fast/freak * ficing more flaky tests * fixing flaky tests * disabled coverage in ros ci * Enable integration tests for ros ci jobs * loosing up some threshold for failing tests * trigger cache * fixing test data in ros ci. Updated flaky test for mac * slaking some test limit * Fixed rtabmap-detectMoreLoopClosures inverted output value * loosing up sift recall on mac * optimizer re-ordered distribution for reproducible results (mac g2o) * macos dump test crash log * combining all tests to save time on shared library reload. Also fixed Logs with missing arguments. * Added ENABLE_FORMAT_ERRORS cmake option * do test only one time * fixed all format warnings * format security android build errors * less verbose tests * updated ImuUThread test * fixed a log * Fixed libpointmatcher 2d normals eigen issue * Fixing libpointmatcher conversion issues * fixing libpointmatcher test on windows ci * cleanup comments, relax some test thr * disabled sequoia-intel ci build (too flaky, would need extensive testing directly on that machine)
2026-08-06 13:32:20 -07:00
// Integration tests that replay full sample databases through Odometry +
// Rtabmap. The pipeline:
// DBReader (stored odom ignored)
// -> Odometry::process // odom is RECOMPUTED here
// -> Rtabmap::process // loop closure / graph
// Everything runs synchronously on the test thread so the replay is
// deterministic and easy to assert against.
//
// Each TEST_F below corresponds to one sample DB fetched by
// scripts/fetch_test_data.sh from data/tests/manifest.txt. The DBs live under
// data/tests/<name>.db, accessed via RTABMAP_TEST_DATA_ROOT (defined in
// corelib/test/CMakeLists.txt). If a file is missing on disk (test data not
// fetched yet) the test is skipped so local builds without test assets still
// pass.
#include <gtest/gtest.h>
#include <rtabmap/core/DBReader.h>
#include <rtabmap/core/Features2d.h>
#include <rtabmap/core/camera/CameraImages.h>
#include <rtabmap/core/Graph.h>
#include <rtabmap/core/LocalGrid.h>
#include <rtabmap/core/OccupancyGrid.h>
#include <rtabmap/core/Odometry.h>
#include <rtabmap/core/Optimizer.h>
#include <rtabmap/core/Memory.h>
#include <rtabmap/core/Signature.h>
#include <rtabmap/core/Version.h>
#ifdef RTABMAP_OCTOMAP
#include <rtabmap/core/OctoMap.h>
#endif
#include <rtabmap/core/OdometryInfo.h>
#include <rtabmap/core/Parameters.h>
#include <rtabmap/core/Rtabmap.h>
#include <rtabmap/core/SensorCaptureInfo.h>
#include <rtabmap/core/SensorCaptureThread.h>
#include <rtabmap/core/SensorData.h>
#include <rtabmap/core/Statistics.h>
#include <rtabmap/core/Transform.h>
#include <rtabmap/core/util3d_filtering.h>
#include <rtabmap/utilite/UFile.h>
#include <rtabmap/utilite/UConversion.h>
#include <rtabmap/utilite/UTimer.h>
#include <rtabmap/utilite/ULogger.h>
#include "TestUtils.h"
#include <opencv2/imgcodecs.hpp>
#include <algorithm>
#include <iostream>
#include <memory>
#include <string>
using namespace rtabmap;
namespace {
std::string testDataPath(const std::string & basename)
{
return std::string(RTABMAP_TEST_DATA_ROOT) + "/tests/" + basename;
}
// Output DB path named after the running test so manual inspection is easy
// (rtabmap-databaseViewer <tempdir>/rtabmap_integration_<TestName>.db). The
// file is overwritten on each run and NOT deleted at teardown.
std::string workDbForCurrentTest(const std::string & suffix = "")
{
const ::testing::TestInfo * info =
::testing::UnitTest::GetInstance()->current_test_info();
const std::string testName = info != nullptr ? info->name() : "unknown";
if(suffix.empty())
{
return test::tempPath(uFormat("rtabmap_integration_%s.db", testName.c_str()));
}
return test::tempPath(uFormat("rtabmap_integration_%s_%s.db",
testName.c_str(), suffix.c_str()));
}
// Result bundle populated by replayDatabase(). Extend as the assertions in the
// per-DB tests grow (e.g. trajectory RMSE, final WM size, time-per-frame, ...).
struct ReplayResult
{
int framesRead = 0; // frames pulled from the DB
int framesProcessed = 0; // frames fed to Rtabmap::process as real nodes
int framesIntermediate = 0; // frames fed to Rtabmap::process with id=-1
int odomNonNull = 0; // odometry returned a non-null pose
int odomLost = 0; // odometry returned a null pose
int loopClosuresAccepted = 0;
int loopClosuresRejected = 0; // sum of frames with Loop/RejectedHypothesis=1
int proximityDetections = 0;
Transform lastOdomPose;
// Latest Gt/translational_rmse from Rtabmap statistics (negative = never
// reported, e.g. DB had no ground truth or Rtabmap/ComputeRMSE was off).
float translationalRmseFinal = -1.0f;
int finalLocalGraphSize = 0; // last Memory/Local_graph_size from stats
int finalGlobalGraphSize = 0; // poses returned by Rtabmap::getGraph(global=true)
std::map<int, Transform> finalLocalPoses; // optimized, global=false
std::map<int, Transform> finalGlobalPoses; // optimized, global=true
// Occupancy-grid cell counts after assembling the global grid from per-
// node local maps (only populated when RGBD/CreateOccupancyGrid=true).
int gridEmptyCells = 0;
int gridObstacleCells = 0;
// OctoMap leaf count (only populated when rtabmap is built with
// RTABMAP_OCTOMAP and RGBD/CreateOccupancyGrid=true). 0 means the
// build didn't have octomap support or the map was empty.
int octomapNodes = 0;
int octomapEmptyCells = 0;
int octomapObstacleCells = 0;
// Wall-clock seconds spent inside the replay loop, measured from
// just before the first DBReader read to just after rtabmap.close().
double replayWallSeconds = 0.0;
// Wall-clock seconds spent inside Odometry::process across all
// frames; divide by framesRead to get per-frame average.
double odomTotalSeconds = 0.0;
};
// Synchronous replay: DBReader -> Odometry::process -> Rtabmap::process.
//
// `rtabmapParameters` configures Rtabmap. `odometryParameters` configures the
// Odometry factory (Odom/Strategy etc.). Splitting the two keeps the per-DB
// tuning explicit -- 3D lidar needs ICP odom while stereo/rgbd need visual
// odom.
//
// If `useStoredOdomAsGuess` is true, the stored odometry in the DB is passed
// as the motion guess (delta from previous frame) to Odometry::process. This
// mirrors rtabmap-reprocess's `useInputOdometryAsGuess` option and is useful
// when the DB has a high-quality odom source (e.g. wheel/IMU) that we want to
// help bootstrap visual/ICP odometry. When false, no guess is provided.
//
// If `passOdomDataToRtabmap` is true, the SensorData modified by Odometry
// (carrying the keypoints/descriptors computed during odom) is forwarded to
// Rtabmap. This pairs with `Mem/UseOdomFeatures=true` to let rtabmap reuse
// odom-extracted features instead of recomputing them -- standard pattern
// for visual SLAM (RGB-D, stereo). When false, the pristine DBReader data
// is passed instead -- standard for lidar/ICP setups.
//
// `goldenStampedGroundTruth` lets a test inject a ground-truth pose by
// stamp on each frame whose stamp matches an entry in the map. This is
// used for datasets that don't ship with ground truth in the DB (e.g.
// Netherdrone) but for which a regression reference has been captured
// from a known-good run. Matching is exact on stamps coming from the
// source DB, so no epsilon is needed. nullptr disables injection.
ReplayResult replayDatabase(
const std::string & dbPath,
const ParametersMap & rtabmapParameters,
const ParametersMap & odometryParameters,
bool useStoredOdomAsGuess = false,
bool passOdomDataToRtabmap = false,
const std::map<double, Transform> * goldenStampedGroundTruth = nullptr,
int frameStride = 1,
const std::string & runLabel = "",
// When true, post-process every stereo frame through
// SensorCaptureThread::postUpdate() with stereo-to-depth enabled.
// The SensorData turns into an RGB-D record (depth = dense disparity
// triangulated from the left/right pair). The odometry + rtabmap
// pipeline then runs the RGB-D path instead of the stereo path.
bool stereoToDepth = false,
// When > 0, points beyond this range (in meters) are dropped from
// the LaserScan of each SensorData right after dbReader.takeData(),
// simulating a lidar with a tighter max range.
float scanMaxRange = 0.0f)
{
ReplayResult result;
// DBReader populates info.odomPose only when odom is NOT ignored. Keep
// it available iff the caller wants to use it as a guess.
const bool odometryIgnored = !useStoredOdomAsGuess;
DBReader dbReader(
dbPath,
0.0f, // frameRate: 0 = process as fast as possible
odometryIgnored,
true, // ignoreGoalDelay
true); // goalsIgnored
if(!dbReader.init())
{
ADD_FAILURE() << "Failed to init DBReader for " << dbPath;
return result;
}
std::unique_ptr<Odometry> odometry(Odometry::create(odometryParameters));
// Optional stereo->depth post-processor. SensorCaptureThread is used
// only for its postUpdate() side-effect (dense disparity from left/right
// + setRGBDImage on the SensorData), not as an actual capture thread.
// Its constructor needs a non-null Camera*, so we hand it a default
// CameraImages we never init -- SensorCaptureThread owns it and
// deletes it on destruction. Dense-matcher knobs live under
// Stereo/Dense/* in odometryParameters, same as a real capture setup.
std::unique_ptr<SensorCaptureThread> stereoToDepthHelper;
if(stereoToDepth)
{
stereoToDepthHelper.reset(new SensorCaptureThread(
new CameraImages(), // owned by SensorCaptureThread
odometryParameters));
stereoToDepthHelper->setStereoToDepth(true);
}
// Output DB at a discoverable path named after the test (with optional
// runLabel suffix to disambiguate per-backend / per-variant runs). We
// erase any previous file so each invocation starts fresh but we
// deliberately do NOT delete it at the end -- callers can inspect it
// with rtabmap-databaseViewer to verify the run looks sensible.
const std::string workDb = workDbForCurrentTest(runLabel);
UFile::erase(workDb);
Rtabmap rtabmap;
rtabmap.init(rtabmapParameters, workDb);
std::cout << "[ ] Output DB: " << workDb << std::endl;
// Honor Rtabmap/DetectionRate (Hz) by gating rtabmap.process on DB frame
// stamps -- same throttling pattern as the rtabmap-reprocess tool.
// Odometry runs on every frame regardless of the detection rate.
float rtabmapDetectionRate = Parameters::defaultRtabmapDetectionRate();
Parameters::parse(rtabmapParameters,
Parameters::kRtabmapDetectionRate(), rtabmapDetectionRate);
const double rtabmapInterval = (rtabmapDetectionRate > 0.0f)
? (1.0 / rtabmapDetectionRate)
: 0.0;
double lastUpdateStamp = 0.0;
// Rtabmap/CreateIntermediateNodes=true changes the throttle behavior:
// instead of dropping throttled frames, we forward them to rtabmap with
// id=-1 so the odom edge (and any laser/IMU payload) is preserved in
// the graph between detection frames. Same mechanism as Reprocess.
bool createIntermediateNodes = Parameters::defaultRtabmapCreateIntermediateNodes();
Parameters::parse(rtabmapParameters,
Parameters::kRtabmapCreateIntermediateNodes(), createIntermediateNodes);
// Stamp-keyed GT override: when the source DB has no stored ground truth,
// a test can supply a reference trajectory and we paste it onto matching
// frames so Rtabmap's native ComputeRMSE machinery (Gt/translational_rmse)
// kicks in. Stamps round-trip exactly through SQLite REAL and C++ literals
// (precision(17) at dump time + C++17 correctly-rounded strtod), so an
// exact find() is enough.
const auto applyGoldenGroundTruth = [goldenStampedGroundTruth](SensorData & d) {
if(goldenStampedGroundTruth == nullptr) return;
const auto it = goldenStampedGroundTruth->find(d.stamp());
if(it != goldenStampedGroundTruth->end())
{
d.setGroundTruth(it->second);
}
};
UTimer replayTimer;
// Some old-format DBs (Stereo20Hz, Version 0.8.0) have no stored
// stamps, so DBReader fills them with wall-clock at read time.
// That makes the Rtabmap/DetectionRate throttle depend on
// processing speed and skews per-optimizer comparisons. Detect
// that case by checking whether the first frame's stamp is
// suspiciously close to "right now" (within the last hour); if
// so, rewrite every frame's stamp to a synthetic monotonic 20 Hz
// timeline.
constexpr double kSyntheticFrameDt = 1.0 / 20.0; // 20 Hz
int syntheticFrameIdx = 0;
bool overrideStamps = false;
// Filter the laser scan of `d` to drop points beyond scanMaxRange (no-op
// when scanMaxRange<=0 or the scan is empty). Keeps the simulated-lidar
// range cap uniform across all takeData() call sites.
const auto applyScanRangeFilter = [scanMaxRange](SensorData & d) {
if(scanMaxRange <= 0.0f || d.laserScanRaw().isEmpty()) return;
d.setLaserScan(util3d::commonFiltering(
d.laserScanRaw(),
/*downsamplingStep=*/0,
/*rangeMin=*/0.0f,
/*rangeMax=*/scanMaxRange));
};
// Prime the loop with the first sample.
SensorCaptureInfo info;
SensorData data = dbReader.takeData(&info);
if(stereoToDepthHelper) stereoToDepthHelper->postUpdate(&data, &info);
applyScanRangeFilter(data);
overrideStamps = data.stamp() > UTimer::now() - 3600.0;
if(overrideStamps)
{
data.setStamp(syntheticFrameIdx++ * kSyntheticFrameDt);
}
applyGoldenGroundTruth(data);
Transform previousStoredOdomPose;
while(data.isValid())
{
++result.framesRead;
// Drop (stride-1) of every `stride` frames before any
// odom/rtabmap processing. Note: lastUpdateStamp /
// previousStoredOdomPose advance only on processed frames,
// so the throttle window still measures against the last
// frame we actually fed in.
if(frameStride > 1 && (result.framesRead - 1) % frameStride != 0)
{
data = dbReader.takeData(&info);
if(stereoToDepthHelper) stereoToDepthHelper->postUpdate(&data, &info);
applyScanRangeFilter(data);
if(overrideStamps && data.isValid())
{
data.setStamp(syntheticFrameIdx++ * kSyntheticFrameDt);
}
applyGoldenGroundTruth(data);
continue;
}
// Build the motion guess from the stored odom delta if requested.
// Null Transform = no guess.
Transform guess;
if(useStoredOdomAsGuess
&& !info.odomPose.isNull()
&& !previousStoredOdomPose.isNull())
{
guess = previousStoredOdomPose.inverse() * info.odomPose;
}
if(!info.odomPose.isNull())
{
previousStoredOdomPose = info.odomPose;
}
// Hand odometry a working copy. Depending on passOdomDataToRtabmap
// we either keep the pristine `data` for rtabmap (lidar/ICP path) or
// forward the odom-modified `odomData` to rtabmap (visual SLAM path,
// pairs with Mem/UseOdomFeatures=true so rtabmap reuses the
// keypoints/descriptors odom already extracted).
SensorData odomData = data;
OdometryInfo odomInfo;
UTimer odomTimer;
const Transform odomPose = odometry->process(odomData, guess, &odomInfo);
result.odomTotalSeconds += odomTimer.getElapsedTime();
if(odomPose.isNull())
{
++result.odomLost;
// Log the failure reason so tests can diagnose ICP odometry
// drops (e.g. truncated-scan variants of the corridor test).
std::cerr << "[odom-lost] frame=" << result.framesRead
<< " stamp=" << data.stamp()
<< " rejected=\"" << odomInfo.reg.rejectedMsg << "\""
<< " inliers=" << odomInfo.reg.inliers
<< " matches=" << odomInfo.reg.matches
<< " icpInliersRatio=" << odomInfo.reg.icpInliersRatio
<< " icpStructuralComplexity=" << odomInfo.reg.icpStructuralComplexity
<< std::endl;
}
else
{
++result.odomNonNull;
result.lastOdomPose = odomPose;
const bool throttle = rtabmapInterval > 0.0
&& lastUpdateStamp > 0.0
&& data.stamp() < lastUpdateStamp + rtabmapInterval;
if(!throttle || createIntermediateNodes)
{
cv::Mat covariance = (!odomInfo.reg.covariance.empty()
&& odomInfo.reg.covariance.total() == 36)
? odomInfo.reg.covariance
: cv::Mat::eye(6, 6, CV_64FC1) * 0.001;
// Copy so id=-1 on throttled frames doesn't mutate the working
// `data` / `odomData` -- keeps the loop's reasoning simple.
SensorData rtabmapData = passOdomDataToRtabmap ? odomData : data;
if(throttle)
{
rtabmapData.setId(-1); // intermediate node
}
rtabmap.process(rtabmapData, odomPose, covariance);
if(throttle)
{
// Detection cadence is gated on real (non-intermediate)
// nodes, so don't advance lastUpdateStamp here.
++result.framesIntermediate;
}
else
{
lastUpdateStamp = rtabmapData.stamp();
++result.framesProcessed;
const Statistics & stats = rtabmap.getStatistics();
if(stats.loopClosureId() > 0)
{
++result.loopClosuresAccepted;
}
if(stats.proximityDetectionId() > 0)
{
++result.proximityDetections;
}
// Rtabmap publishes Gt/translational_rmse on every process
// call when ComputeRMSE is on and the DB has ground truth.
// Keep the latest value -- that's the final-trajectory RMSE.
const auto rmseIt = stats.data().find(
Statistics::kGtTranslational_rmse());
if(rmseIt != stats.data().end())
{
result.translationalRmseFinal = rmseIt->second;
}
// finalLocalGraphSize is read from getGraph at end of replay,
// not from the stats map -- that way both local and global
// counts come from the same source.
}
}
}
data = dbReader.takeData(&info);
if(stereoToDepthHelper) stereoToDepthHelper->postUpdate(&data, &info);
applyScanRangeFilter(data);
if(overrideStamps && data.isValid())
{
data.setStamp(syntheticFrameIdx++ * kSyntheticFrameDt);
}
applyGoldenGroundTruth(data);
}
// Snapshot both local and global graphs BEFORE closing: close(true) tears
// down memory state. global=true includes nodes that have been moved to
// LTM; global=false is just the working-memory subset.
{
std::multimap<int, Link> constraints;
rtabmap.getGraph(result.finalLocalPoses, constraints,
/*optimized=*/true, /*global=*/false);
result.finalLocalGraphSize = (int)result.finalLocalPoses.size();
constraints.clear();
rtabmap.getGraph(result.finalGlobalPoses, constraints,
/*optimized=*/true, /*global=*/true);
result.finalGlobalGraphSize = (int)result.finalGlobalPoses.size();
}
// Assemble the global occupancy grid from the per-node local grids that
// rtabmap saved (only meaningful when RGBD/CreateOccupancyGrid=true).
// Pull poses + signatures with grids attached, prime a LocalGridCache,
// run OccupancyGrid::update, then count cells in the resulting cv::Mat
// (-1 = unknown, 0 = empty, 100 = obstacle).
bool createOccupancyGrid = Parameters::defaultRGBDCreateOccupancyGrid();
Parameters::parse(rtabmapParameters,
Parameters::kRGBDCreateOccupancyGrid(), createOccupancyGrid);
if(createOccupancyGrid)
{
std::map<int, Transform> poses;
std::multimap<int, Link> constraints;
std::map<int, Signature> signatures;
rtabmap.getGraph(poses, constraints,
/*optimized=*/true, /*global=*/true, &signatures,
/*withImages=*/false, /*withScan=*/false, /*withUserData=*/false,
/*withGrid=*/true, /*withWords=*/false,
/*withGlobalDescriptors=*/false);
LocalGridCache mapCache;
for(auto & p : signatures)
{
cv::Mat ground, obstacles, empty;
p.second.sensorData().uncompressDataConst(
0, 0, 0, 0, &ground, &obstacles, &empty);
if(!ground.empty() || !obstacles.empty() || !empty.empty())
{
mapCache.add(p.first, ground, obstacles, empty,
p.second.sensorData().gridCellSize(),
p.second.sensorData().gridViewPoint());
}
}
OccupancyGrid grid(&mapCache, rtabmapParameters);
grid.update(poses);
float xMin = 0.0f, yMin = 0.0f;
const cv::Mat gridMat = grid.getMap(xMin, yMin);
for(int i = 0; i < gridMat.rows; ++i)
{
for(int j = 0; j < gridMat.cols; ++j)
{
const signed char v = gridMat.at<signed char>(i, j);
if(v == 0) ++result.gridEmptyCells;
else if(v == 100) ++result.gridObstacleCells;
}
}
#ifdef RTABMAP_OCTOMAP
// Build a 3D OctoMap from the same cache+poses. Useful when
// Grid/RayTracing=true (which needs OctoMap support per the param
// doc) and a quick sanity check on the resulting tree size.
// Pin the OctoMap's resolution to the local grids' actual cell size
// (set when Memory built them at process() time) so the OcTree leaf
// size matches the data, regardless of any subsequent Grid/CellSize
// edits in `rtabmapParameters`.
ParametersMap octoMapParameters = rtabmapParameters;
for(const auto & p : signatures)
{
const float cs = p.second.sensorData().gridCellSize();
if(cs > 0.0f)
{
octoMapParameters[Parameters::kGridCellSize()] = uNumber2Str(cs);
break;
}
}
OctoMap octomap(&mapCache, octoMapParameters);
octomap.update(poses);
if(octomap.octree() != nullptr)
{
result.octomapNodes = (int)octomap.octree()->size();
std::vector<int> obstacleIdx, emptyIdx, groundIdx;
octomap.createCloud(/*treeDepth=*/0, &obstacleIdx, &emptyIdx, &groundIdx);
result.octomapObstacleCells = (int)obstacleIdx.size();
// Treat ground-classified cells as empty for the purposes of this
// test (they're free space, just labelled separately).
result.octomapEmptyCells = (int)emptyIdx.size() + (int)groundIdx.size();
}
#endif
}
// close(true) flushes the in-memory session to the output DB so the file
// at workDb is a complete, openable database after the test returns.
rtabmap.close(true);
result.replayWallSeconds = replayTimer.getElapsedTime();
std::cout << "[ ] Replay summary:"
<< " framesRead=" << result.framesRead
<< " odomNonNull=" << result.odomNonNull
<< " odomLost=" << result.odomLost
<< " framesProcessed=" << result.framesProcessed
<< " framesIntermediate=" << result.framesIntermediate
<< " loops=" << result.loopClosuresAccepted
<< " proximity=" << result.proximityDetections
<< " localGraph=" << result.finalLocalGraphSize
<< " globalGraph=" << result.finalGlobalGraphSize
<< " gridEmpty=" << result.gridEmptyCells
<< " gridObstacle=" << result.gridObstacleCells
<< " octomap=" << result.octomapNodes
<< " octomapEmpty=" << result.octomapEmptyCells
<< " octomapObstacle=" << result.octomapObstacleCells
<< " rmse=" << result.translationalRmseFinal << "m"
<< " wall=" << result.replayWallSeconds << "s"
<< " odom/frame=" << (result.framesRead > 0
? (result.odomTotalSeconds / result.framesRead) * 1000.0
: 0.0) << "ms"
<< std::endl;
return result;
}
// Replay variant that feeds the stored odometry pose straight to Rtabmap
// without re-running an Odometry stage. Used for datasets where the DB
// already carries a known-good odom track and the test only cares about
// the back-end (loop closure detection + graph optimization).
ReplayResult replayDatabaseWithStoredOdom(
const std::string & dbPath,
const std::string & workDb,
const ParametersMap & rtabmapParameters,
int triggerNewMapAfterFrame = -1,
// When >0, overrides the angular diagonal entries of the stored
// odom covariance (indices 3,4,5) before each call to
// Rtabmap::process. Lets a test relax an unrealistically tight
// rotational variance baked into the DB.
double overrideOdomAngularVariance = -1.0,
// When >0, same idea for the translational diagonal (0,1,2).
double overrideOdomLinearVariance = -1.0,
// When >0, points beyond this range (in meters) are dropped from
// the LaserScan of each SensorData after dbReader.takeData(),
// simulating a lidar with a tighter max range.
float scanMaxRange = 0.0f)
{
ReplayResult result;
// odometryIgnored=false so DBReader populates info.odomPose.
// featuresIgnored=false so DBReader replays the stored keypoints /
// descriptors instead of forcing Rtabmap to re-extract — paired with
// Mem/UseOdomFeatures=true in the per-variant parameters so Rtabmap
// actually reuses them rather than recomputing on every frame.
DBReader dbReader(
dbPath,
0.0f, // frameRate: 0 = process as fast as possible
false, // odometryIgnored
true, // ignoreGoalDelay
true, // goalsIgnored
0, // startId
std::vector<unsigned int>(), // cameraIndices
0, // stopId
false, // intermediateNodesIgnored
false, // landmarksIgnored
false); // featuresIgnored
if(!dbReader.init())
{
ADD_FAILURE() << "Failed to init DBReader for " << dbPath;
return result;
}
UFile::erase(workDb);
Rtabmap rtabmap;
rtabmap.init(rtabmapParameters, workDb);
std::cout << "[ ] Output DB: " << workDb << std::endl;
// Honor Rtabmap/DetectionRate (Hz) by gating rtabmap.process on DB frame
// stamps -- mirrors the throttle in replayDatabase(). When
// Rtabmap/CreateIntermediateNodes=true, throttled frames are forwarded
// with id=-1 so the odom edge + payload are preserved in the graph
// between detection frames; otherwise they are dropped.
float rtabmapDetectionRate = Parameters::defaultRtabmapDetectionRate();
Parameters::parse(rtabmapParameters,
Parameters::kRtabmapDetectionRate(), rtabmapDetectionRate);
const double rtabmapInterval = (rtabmapDetectionRate > 0.0f)
? (1.0 / rtabmapDetectionRate)
: 0.0;
double lastUpdateStamp = 0.0;
bool createIntermediateNodes = Parameters::defaultRtabmapCreateIntermediateNodes();
Parameters::parse(rtabmapParameters,
Parameters::kRtabmapCreateIntermediateNodes(), createIntermediateNodes);
// Filter the laser scan of `d` to drop points beyond scanMaxRange.
// No-op when scanMaxRange<=0 or the scan is empty.
const auto applyScanRangeFilter = [scanMaxRange](SensorData & d) {
if(scanMaxRange <= 0.0f || d.laserScanRaw().isEmpty()) return;
d.setLaserScan(util3d::commonFiltering(
d.laserScanRaw(),
/*downsamplingStep=*/0,
/*rangeMin=*/0.0f,
/*rangeMax=*/scanMaxRange));
};
UTimer replayTimer;
SensorCaptureInfo info;
SensorData data = dbReader.takeData(&info);
applyScanRangeFilter(data);
while(data.isValid())
{
++result.framesRead;
// In this replay mode the DB is expected to carry a stored odom
// pose and covariance on every frame; treat either being missing
// as a malformed asset rather than silently skipping.
if(info.odomPose.isNull())
{
ADD_FAILURE() << "Frame " << result.framesRead
<< " has no stored odometry pose";
return result;
}
if(info.odomCovariance.empty() || info.odomCovariance.total() != 36)
{
ADD_FAILURE() << "Frame " << result.framesRead
<< " has no stored odometry covariance";
return result;
}
if(overrideOdomLinearVariance > 0.0)
{
info.odomCovariance.at<double>(0, 0) = overrideOdomLinearVariance;
info.odomCovariance.at<double>(1, 1) = overrideOdomLinearVariance;
info.odomCovariance.at<double>(2, 2) = overrideOdomLinearVariance;
}
if(overrideOdomAngularVariance > 0.0)
{
info.odomCovariance.at<double>(3, 3) = overrideOdomAngularVariance;
info.odomCovariance.at<double>(4, 4) = overrideOdomAngularVariance;
info.odomCovariance.at<double>(5, 5) = overrideOdomAngularVariance;
}
result.lastOdomPose = info.odomPose;
const bool throttle = rtabmapInterval > 0.0
&& lastUpdateStamp > 0.0
&& data.stamp() < lastUpdateStamp + rtabmapInterval;
if(throttle && !createIntermediateNodes)
{
data = dbReader.takeData(&info);
applyScanRangeFilter(data);
continue;
}
SensorData rtabmapData = data;
if(throttle)
{
rtabmapData.setId(-1); // intermediate node
}
rtabmap.process(rtabmapData, info.odomPose, info.odomCovariance);
if(throttle)
{
++result.framesIntermediate;
data = dbReader.takeData(&info);
applyScanRangeFilter(data);
continue;
}
lastUpdateStamp = data.stamp();
++result.framesProcessed;
// Caller-driven session split: trigger a fresh map once the
// configured number of frames has been processed. Used by tests
// to exercise multi-session graph behavior on a single-session
// source DB.
if(triggerNewMapAfterFrame > 0
&& result.framesProcessed == triggerNewMapAfterFrame)
{
rtabmap.triggerNewMap();
}
const Statistics & stats = rtabmap.getStatistics();
if(stats.loopClosureId() > 0)
{
++result.loopClosuresAccepted;
}
if(stats.proximityDetectionId() > 0)
{
++result.proximityDetections;
}
// Loop/RejectedHypothesis is published as 1.0f on frames where a
// loop closure (or proximity link) was discarded — either by the
// addLink path or by the RGBD/OptimizeMaxError post-optimization
// rejection. Robust + MaxError-enabled variants are expected to
// reject more than the unguarded variants.
const auto rejIt = stats.data().find(Statistics::kLoopRejectedHypothesis());
if(rejIt != stats.data().end() && rejIt->second > 0.5f)
{
++result.loopClosuresRejected;
}
const auto rmseIt = stats.data().find(Statistics::kGtTranslational_rmse());
if(rmseIt != stats.data().end())
{
result.translationalRmseFinal = rmseIt->second;
}
data = dbReader.takeData(&info);
applyScanRangeFilter(data);
}
{
std::multimap<int, Link> constraints;
rtabmap.getGraph(result.finalLocalPoses, constraints,
/*optimized=*/true, /*global=*/false);
result.finalLocalGraphSize = (int)result.finalLocalPoses.size();
constraints.clear();
rtabmap.getGraph(result.finalGlobalPoses, constraints,
/*optimized=*/true, /*global=*/true);
result.finalGlobalGraphSize = (int)result.finalGlobalPoses.size();
}
rtabmap.close(true);
result.replayWallSeconds = replayTimer.getElapsedTime();
std::cout << "[ ] Replay summary:"
<< " framesRead=" << result.framesRead
<< " framesProcessed=" << result.framesProcessed
<< " framesIntermediate=" << result.framesIntermediate
<< " loops=" << result.loopClosuresAccepted
<< " loopsRejected=" << result.loopClosuresRejected
<< " proximity=" << result.proximityDetections
<< " localGraph=" << result.finalLocalGraphSize
<< " globalGraph=" << result.finalGlobalGraphSize
<< " rmse=" << result.translationalRmseFinal << "m"
<< " wall=" << result.replayWallSeconds << "s"
<< std::endl;
return result;
}
ParametersMap baseRtabmapParams()
{
ParametersMap params;
// Per-DB tuning should override these in the individual tests.
params.insert(ParametersPair(Parameters::kMemSTMSize(), "5"));
// Disable motion-gated update so node creation is driven purely by
// Rtabmap/DetectionRate -- makes the replay deterministic frame-by-frame.
params.insert(ParametersPair(Parameters::kRGBDAngularUpdate(), "0.0"));
params.insert(ParametersPair(Parameters::kRGBDCreateOccupancyGrid(), "true"));
params.insert(ParametersPair(Parameters::kRGBDLinearUpdate(), "0.0"));
params.insert(ParametersPair(Parameters::kRtabmapDetectionRate(), "2"));
return params;
}
ParametersMap baseOdometryParams()
{
// Defaults are visual F2M; per-DB tests override Odom/Strategy and any
// related parameters (Vis/* for visual odom, Icp/* for lidar odom, ...).
return ParametersMap();
}
class RtabmapIntegrationFixture : public ::testing::Test {};
} // namespace
// GTEST_SKIP() expands to `return`, so it has to live directly inside the test
// body (not a helper). Each TEST_F resolves the asset path and skips if the
// file is missing -- keeps local builds green for contributors who haven't run
// scripts/fetch_test_data.sh.
#define SKIP_IF_MISSING(path) \
do \
{ \
if(!UFile::exists(path)) \
{ \
GTEST_SKIP() << "Test data not found: " << (path) \
<< " (run scripts/fetch_test_data.sh to populate)"; \
} \
} while(0)
// ---------------------------------------------------------------------------
// 3D lidar sample (Netherdrone, ~15s).
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, NetherdroneLidar3D)
{
const std::string dbPath = testDataPath("netherdrone_lidar3d_sample_15s.db");
SKIP_IF_MISSING(dbPath);
// Drone outdoor 3D lidar -- voxel is the single knob; max-correspondence
// follows at 10x the voxel size (typical ICP rule of thumb for sparse
// lidar scans).
const float voxelSize = 0.3f;
const std::string kVoxelSize = uNumber2Str(voxelSize);
// Loop-closure-side ICP config (Icp/* read by RegistrationIcp).
// Reg/Strategy=1 -> ICP-only registration (no visual features).
// Grid/GroundIsObstacle=true: UAV use case -- no ground segmentation,
// every point is an obstacle in the occupancy grid.
ParametersMap rtabmapParams = baseRtabmapParams();
rtabmapParams[Parameters::kGridCellSize()] = kVoxelSize;
rtabmapParams[Parameters::kGridGroundIsObstacle()] = "true";
rtabmapParams[Parameters::kGridRayTracing()] = "true";
rtabmapParams[Parameters::kGridSensor()] = "0";
rtabmapParams[Parameters::kIcpEpsilon()] = "0.001";
rtabmapParams[Parameters::kIcpIterations()] = "10";
rtabmapParams[Parameters::kIcpMaxCorrespondenceDistance()] = uNumber2Str(voxelSize * 10.0f);
rtabmapParams[Parameters::kIcpMaxTranslation()] = "3";
// OutlierRatio means different things per ICP backend (see Parameters.h):
// libpointmatcher uses it as TrimmedDist keep-ratio (mild trim at 0.7);
// PCL uses it as a RANSAC threshold multiplier on maxCorrespondenceDistance,
// where 0.1 gives the aggressive filtering this sparse lidar needs.
#ifdef RTABMAP_POINTMATCHER
rtabmapParams[Parameters::kIcpOutlierRatio()] = "0.7";
#else
rtabmapParams[Parameters::kIcpOutlierRatio()] = "0.1";
#endif
rtabmapParams[Parameters::kIcpPointToPlane()] = "true";
rtabmapParams[Parameters::kIcpPointToPlaneK()] = "20";
rtabmapParams[Parameters::kIcpPointToPlaneRadius()] = "0";
rtabmapParams[Parameters::kIcpStrategy()] = "1";
rtabmapParams[Parameters::kIcpVoxelSize()] = kVoxelSize;
rtabmapParams[Parameters::kMemIntermediateNodeDataKept()] = "true";
rtabmapParams[Parameters::kRegStrategy()] = "1";
rtabmapParams[Parameters::kRtabmapCreateIntermediateNodes()] = "true";
// Odometry-side: inherit the Icp/* baseline, then layer odom-specific
// overrides (scan-keyframe, F2M scan map size, ICP correspondence ratio).
ParametersMap odomParams = rtabmapParams;
odomParams[Parameters::kIcpCorrespondenceRatio()] = "0.01";
odomParams[Parameters::kOdomF2MBundleAdjustment()] = "false";
odomParams[Parameters::kOdomF2MScanMaxSize()] = "15000";
odomParams[Parameters::kOdomF2MScanSubtractRadius()] = kVoxelSize;
odomParams[Parameters::kOdomScanKeyFrameThr()] = "0.4";
// Golden trajectory captured from a known-good run, keyed by source-DB
// stamp (invariant across rtabmap renumbering). Injected as ground truth
// on matching SensorData frames so Rtabmap's native ComputeRMSE machinery
// (Gt/translational_rmse stat) does the comparison -- same path as the
// PR2 tests that ship with stored GT. The Netherdrone DB has no stored
// GT of its own, so this is a self-anchored regression check.
const std::map<double, Transform> goldenStampedGT = {
{1613418442.8843718, Transform(0.99832969903945923f, 0.00051550386706367135f, 0.057771574705839157f, -1.6495448367424946e-19f, 0.00051560450810939074f, 0.99984085559844971f, -0.017831696197390556f, 3.4403514425937326e-20f, -0.057771574705839157f, 0.017831698060035706f, 0.99817055463790894f, 7.6593389817761406e-20f)},
{1613418443.3844736, Transform(0.99832785129547119f, 0.0028989869169890881f, 0.057732503861188889f, 0.17843475937843323f, -0.0020826261024922132f, 0.99989718198776245f, -0.014195555821061134f, -0.0066802469082176685f, -0.057767719030380249f, 0.014051581732928753f, 0.99823129177093506f, 0.17401190102100372f)},
{1613418443.9842608, Transform(0.99834167957305908f, 0.0053970343433320522f, 0.057313427329063416f, 0.40323537588119507f, -0.0040137777104973793f, 0.9996984601020813f, -0.024222658947110176f, -0.018803196027874947f, -0.057426892220973969f, 0.023952441290020943f, 0.99806231260299683f, 0.40222784876823425f)},
{1613418444.5840302, Transform(0.99913626909255981f, 0.0034218172077089548f, 0.041410472244024277f, 0.65142530202865601f, -0.0028540806379169226f, 0.9999011754989624f, -0.013761336915194988f, -0.042952436953783035f, -0.041453473269939423f, 0.013631262816488743f, 0.99904739856719971f, 0.63346731662750244f)},
{1613418445.0840809, Transform(0.99995774030685425f, 0.0023752534762024879f, -0.0088843861594796181f, 0.82112884521484375f, -0.0024402674753218889f, 0.99997025728225708f, -0.0073141087777912617f, -0.067268162965774536f, 0.0088667487725615501f, 0.0073354821652173996f, 0.99993377923965454f, 0.85938411951065063f)},
{1613418445.6839614, Transform(0.99883186817169189f, 0.0049950624816119671f, 0.048063535243272781f, 0.86203396320343018f, -0.0041339104063808918f, 0.99982929229736328f, -0.017999691888689995f, -0.057375259697437286f, -0.048145238310098648f, 0.017779972404241562f, 0.99868214130401611f, 0.9297715425491333f)},
{1613418446.1842918, Transform(0.99878597259521484f, 0.0048005376011133194f, 0.049027431756258011f, 0.88737571239471436f, -0.0036628940142691135f, 0.99972248077392578f, -0.023267785087227821f, -0.092432446777820587f, -0.04912552610039711f, 0.02305995300412178f, 0.99852651357650757f, 0.85799181461334229f)},
{1613418446.6844673, Transform(0.99829369783401489f, 0.00050088047282770276f, 0.058391634374856949f, 0.93222159147262573f, 0.00087454286403954029f, 0.99972283840179443f, -0.023527214303612709f, -0.091116242110729218f, -0.058387219905853271f, 0.023538138717412949f, 0.99801653623580933f, 0.87153005599975586f)},
{1613418447.2841945, Transform(0.99886816740036011f, 0.01005473081022501f, 0.046490758657455444f, 1.0597318410873413f, -0.009820220060646534f, 0.99993777275085449f, -0.0052699404768645763f, -0.091255262494087219f, -0.046540863811969757f, 0.0048074256628751755f, 0.9989047646522522f, 0.92329776287078857f)},
{1613418447.784642, Transform(0.99902480840682983f, 0.0161009281873703f, 0.041110377758741379f, 1.1376457214355469f, -0.01559132244437933f, 0.99979794025421143f, -0.012686838395893574f, 0.00506593007594347f, -0.041306335479021072f, 0.012033500708639622f, 0.99907416105270386f, 0.9223446249961853f)},
{1613418448.2847199, Transform(0.99957424402236938f, 0.015879219397902489f, -0.024478213861584663f, 1.177858829498291f, -0.016155127435922623f, 0.99980771541595459f, -0.011115322820842266f, 0.022787714377045631f, 0.024297002702951431f, 0.011506041511893272f, 0.99963855743408203f, 0.95410776138305664f)},
{1613418448.7850029, Transform(0.99747771024703979f, 0.013958192430436611f, 0.069593988358974457f, 1.0981137752532959f, -0.011846709065139294f, 0.99945962429046631f, -0.030660992488265038f, 0.073311552405357361f, -0.069984368979930878f, 0.029759196564555168f, 0.99710404872894287f, 1.0477849245071411f)},
{1613418449.2854297, Transform(0.99874883890151978f, 0.014832595363259315f, 0.047757040709257126f, 1.0584510564804077f, -0.01404693815857172f, 0.99976098537445068f, -0.016744945198297501f, 0.11667603254318237f, -0.047993998974561691f, 0.016053156927227974f, 0.99871867895126343f, 1.339044451713562f)},
{1613418449.8841302, Transform(0.99820965528488159f, 0.016053171828389168f, 0.057617094367742538f, 1.0097041130065918f, -0.014304077252745628f, 0.99942803382873535f, -0.030642321333289146f, 0.15719693899154663f, -0.058076050132513046f, 0.029763301834464073f, 0.99786841869354248f, 1.530038595199585f)},
{1613418450.3843191, Transform(0.99840420484542847f, 0.01184108667075634f, 0.055216036736965179f, 0.96206194162368774f, -0.0086531788110733032f, 0.99830114841461182f, -0.057620875537395477f, 0.15269020199775696f, -0.055804520845413208f, 0.057051137089729309f, 0.99681037664413452f, 1.6020523309707642f)},
{1613418450.9838331, Transform(0.99857664108276367f, 0.0076439883559942245f, 0.052786123007535934f, 0.93738365173339844f, -0.002835016930475831f, 0.99588495492935181f, -0.090583465993404388f, 0.019595114514231682f, -0.053261328488588333f, 0.09030488133430481f, 0.99448889493942261f, 1.5854558944702148f)},
{1613418451.4839463, Transform(0.99867540597915649f, -0.0012489983346313238f, 0.051436353474855423f, 0.94985419511795044f, 0.0019668119493871927f, 0.99990135431289673f, -0.013907111249864101f, -0.2961670458316803f, -0.051413904875516891f, 0.013989857397973537f, 0.99857938289642334f, 1.5656760931015015f)},
{1613418452.0835037, Transform(0.99909251928329468f, 0.0077475365251302719f, 0.041883502155542374f, 0.96908277273178101f, -0.0093348808586597443f, 0.99924039840698242f, 0.037837300449609756f, -0.43317463994026184f, -0.041558541357517242f, -0.038193941116333008f, 0.99840593338012695f, 1.7838516235351562f)},
{1613418452.6833203, Transform(0.99895727634429932f, 0.010300842113792896f, 0.04447576031088829f, 0.99292933940887451f, -0.013362647965550423f, 0.9975200891494751f, 0.069103263318538666f, -0.48763060569763184f, -0.043653644621372223f, -0.069625511765480042f, 0.99661749601364136f, 1.9300179481506348f)},
{1613418453.1836057, Transform(0.99860244989395142f, 0.0083182761445641518f, 0.052192755043506622f, 1.0400835275650024f, -0.0065913721919059753f, 0.99942797422409058f, -0.033172395080327988f, -0.40978887677192688f, -0.052438832819461823f, 0.032782018184661865f, 0.99808579683303833f, 2.0495405197143555f)},
{1613418453.7834945, Transform(0.99882996082305908f, 0.0098624005913734436f, 0.047345634549856186f, 1.1099979877471924f, -0.0088436063379049301f, 0.99972593784332275f, -0.021679745987057686f, -0.29520484805107117f, -0.047546472400426865f, 0.021235672757029533f, 0.99864327907562256f, 2.3696367740631104f)},
{1613418454.2839301, Transform(0.99896800518035889f, 0.010073220357298851f, 0.044289212673902512f, 1.155259370803833f, -0.0096654985100030899f, 0.99990898370742798f, -0.0094104120507836342f, -0.22011889517307281f, -0.044379975646734238f, 0.0089726224541664124f, 0.99897438287734985f, 2.5511965751647949f)},
{1613418454.8842895, Transform(0.9952349066734314f, 0.092743024230003357f, 0.030103979632258415f, 1.2314082384109497f, -0.092207059264183044f, 0.99556368589401245f, -0.018731595948338509f, -0.15043841302394867f, -0.031707651913166046f, 0.015866540372371674f, 0.9993712306022644f, 2.6318151950836182f)},
{1613418455.3845851, Transform(0.99552649259567261f, 0.090829521417617798f, 0.026020960882306099f, 1.2905718088150024f, -0.089119181036949158f, 0.99416971206665039f, -0.060699313879013062f, -0.046864170581102371f, -0.031382542103528976f, 0.058108806610107422f, 0.99781686067581177f, 2.6263918876647949f)},
{1613418455.984123, Transform(0.99200868606567383f, 0.11816086620092392f, 0.044235825538635254f, 1.3500221967697144f, -0.11883093416690826f, 0.99283158779144287f, 0.012827672064304352f, -0.09510079026222229f, -0.042402993887662888f, -0.017981745302677155f, 0.99893879890441895f, 2.5739231109619141f)},
{1613418456.4845514, Transform(0.98325234651565552f, 0.17734897136688232f, 0.041978854686021805f, 1.404977560043335f, -0.17656248807907104f, 0.98404836654663086f, -0.021783677861094475f, 0.030498344451189041f, -0.045172542333602905f, 0.014006962068378925f, 0.99888098239898682f, 2.5444049835205078f)},
{1613418457.0843911, Transform(0.98150634765625f, 0.18732210993766785f, 0.039444118738174438f, 1.4734765291213989f, -0.18633481860160828f, 0.98210400342941284f, -0.02740548737347126f, 0.011144352145493031f, -0.04387187585234642f, 0.019548846408724785f, 0.99884587526321411f, 2.6882264614105225f)},
{1613418457.5845294, Transform(0.96550232172012329f, 0.25460636615753174f, 0.054596912115812302f, 1.5147770643234253f, -0.25377687811851501f, 0.96701842546463013f, -0.021739022806286812f, 0.027287963777780533f, -0.058331117033958435f, 0.0071336426772177219f, 0.9982718825340271f, 2.7107915878295898f)},
{1613418458.1838984, Transform(0.95447641611099243f, 0.29159033298492432f, 0.06284746527671814f, 1.6193532943725586f, -0.29063645005226135f, 0.95653194189071655f, -0.024023318663239479f, 0.063806936144828796f, -0.067120566964149475f, 0.0046639293432235718f, 0.9977339506149292f, 2.659712553024292f)},
{1613418458.6839559, Transform(0.9399188756942749f, 0.34112688899040222f, 0.013601194135844707f, 1.7090979814529419f, -0.34031608700752258f, 0.93936562538146973f, -0.042157087475061417f, 0.074068896472454071f, -0.027157410979270935f, 0.034995537251234055f, 0.99901843070983887f, 2.680656909942627f)},
{1613418459.2839231, Transform(0.91136699914932251f, 0.41152855753898621f, 0.0073850555345416069f, 1.609864354133606f, -0.40951347351074219f, 0.90841454267501831f, -0.084152914583683014f, -0.031468704342842102f, -0.041340012103319168f, 0.073669910430908203f, 0.99642544984817505f, 2.6887660026550293f)},
};
const ReplayResult result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/false,
/*passOdomDataToRtabmap=*/false,
/*goldenStampedGroundTruth=*/&goldenStampedGT);
EXPECT_GT(result.framesRead, 0);
EXPECT_EQ(0, result.odomLost) << "Odometry should never lose tracking";
EXPECT_EQ(31, result.finalLocalGraphSize);
EXPECT_EQ(165, result.finalGlobalGraphSize);
#ifdef RTABMAP_OCTOMAP
// Grid/RayTracing requires OctoMap support; verify the 3D map was
// actually assembled when the build has it. ICP-only replay is
// deterministic on a given platform but absolute leaf counts can shift
// slightly across PCL/Eigen/OpenMP configurations, so use a small
// tolerance (~1-3%) rather than exact equality.
EXPECT_NEAR(21372, result.octomapNodes, 300);
EXPECT_NEAR(16178, result.octomapEmptyCells, 300);
EXPECT_NEAR(1845, result.octomapObstacleCells, 50);
#endif
// libpointmatcher's TrimmedDist outlier filter aligns this sparse 3D-lidar
// dataset to ~1 mm RMSE against the golden trajectory on Linux; Windows
// math-lib differences push it slightly higher (~1.5 mm observed in CI).
// With PCL ICP the best we can do is a RANSAC correspondence rejector
// (see util3d_registration.cpp), which converges but to a looser ~3 cm RMSE.
ASSERT_GE(result.translationalRmseFinal, 0.0f)
<< "No Gt/translational_rmse in stats (golden GT not injected?)";
#ifdef RTABMAP_POINTMATCHER
EXPECT_LT(result.translationalRmseFinal, 0.002f)
<< "Final trajectory RMSE = " << result.translationalRmseFinal << " m";
#else
EXPECT_LT(result.translationalRmseFinal, 0.05f)
<< "Final trajectory RMSE = " << result.translationalRmseFinal << " m";
#endif
}
// ---------------------------------------------------------------------------
// PR2 2D-laser + stereo sample (~15s).
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, PR2_Scan2D_Stereo)
{
const std::string dbPath = testDataPath("pr2_scan2d_stereo_sample_15s.db");
SKIP_IF_MISSING(dbPath);
// Iterate over the BA-capable optimizers built into this rtabmap: CI
// containers ship with different combos (e.g. only ceres+toro), so each
// variant is skipped when its optimizer is unavailable.
//
// rmseBound is per-optimizer: g2o/gtsam converge to ~3 cm on this dataset,
// but the ceres BA backend settles on a looser solution (~10 cm observed),
// so it gets a wider bound rather than loosening the check for all variants.
struct Variant {
Optimizer::Type opt;
const char * label;
float rmseBound;
int gridObstacleMax;
int octomapObstacleMax;
};
const std::vector<Variant> variants = {
{Optimizer::kTypeG2O, "g2o", 0.05f, 5300, 23000},
{Optimizer::kTypeGTSAM, "gtsam", 0.05f, 5300, 23000},
{Optimizer::kTypeCeres, "ceres", 0.10f, 5700, 24500},
};
int variantsTested = 0;
for(const Variant & v : variants)
{
if(!Optimizer::isAvailable(v.opt))
{
std::cerr << "[skip] optimizer " << v.label << " not available\n";
continue;
}
SCOPED_TRACE(std::string("variant=") + v.label);
const std::string strategy = uNumber2Str(static_cast<int>(v.opt));
ParametersMap rtabmapParams = baseRtabmapParams();
rtabmapParams[Parameters::kMemUseOdomFeatures()] = "true";
rtabmapParams[Parameters::kOptimizerStrategy()] = strategy;
rtabmapParams[Parameters::kVisBundleAdjustment()] = strategy;
ParametersMap odomParams = baseOdometryParams();
odomParams[Parameters::kOdomF2MBundleAdjustment()] = strategy;
// passOdomDataToRtabmap=true: rtabmap reuses the keypoints/descriptors
// extracted during odometry (paired with Mem/UseOdomFeatures=true above).
const ReplayResult result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/true,
/*passOdomDataToRtabmap=*/true,
/*goldenStampedGroundTruth=*/nullptr,
/*frameStride=*/1,
/*runLabel=*/v.label);
EXPECT_GT(result.framesRead, 0);
EXPECT_EQ(0, result.odomLost)
<< v.label << ": Odometry should never lose tracking";
EXPECT_EQ(27, result.finalGlobalGraphSize) << v.label;
EXPECT_GE(result.proximityDetections, 1)
<< v.label << ": PR2 2D-scan dataset should produce proximity detections";
EXPECT_GE(result.gridEmptyCells, 400) << v.label;
EXPECT_LE(result.gridEmptyCells, 650) << v.label;
EXPECT_GE(result.gridObstacleCells, 4800) << v.label;
EXPECT_LE(result.gridObstacleCells, v.gridObstacleMax) << v.label;
#ifdef RTABMAP_OCTOMAP
EXPECT_GE(result.octomapEmptyCells, 1700) << v.label;
EXPECT_LE(result.octomapEmptyCells, 2100) << v.label;
EXPECT_GE(result.octomapObstacleCells, 21000) << v.label;
EXPECT_LE(result.octomapObstacleCells, v.octomapObstacleMax) << v.label;
#endif
// Stereo F2M visual odom + visual loop closure. Bound is per-optimizer
// (see Variant.rmseBound above): ~3 cm for g2o/gtsam, looser for ceres.
ASSERT_GE(result.translationalRmseFinal, 0.0f)
<< v.label << ": No Gt/translational_rmse in stats (ground truth missing?)";
EXPECT_LT(result.translationalRmseFinal, v.rmseBound)
<< v.label << " Final trajectory RMSE = " << result.translationalRmseFinal << " m";
++variantsTested;
}
ASSERT_GT(variantsTested, 0) << "no BA-capable optimizer was available";
}
// ---------------------------------------------------------------------------
// Stereo 20 Hz tutorial DB (~1035 frames, no stored odometry or graph).
// Smoke-tests the full visual SLAM pipeline: stereo F2M odometry, loop
// closure detection, graph optimization — all starting from raw imagery.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, Stereo20Hz)
{
const std::string dbPath = testDataPath("stereo_20Hz.db");
SKIP_IF_MISSING(dbPath);
const std::string goldenPath = testDataPath("stereo_20Hz_gt.g2o");
std::map<int, Transform> goldenPoses;
std::multimap<int, Link> goldenLinks;
ASSERT_TRUE(graph::importPoses(
goldenPath, /*format=*/4, goldenPoses, &goldenLinks))
<< "Failed to load golden poses from " << goldenPath;
// Variants:
// - g2o / gtsam / ceres baseline (vary only the BA backend).
// - g2o + Stereo/OpticalFlow=false: switches stereo correspondence
// from KLT optical-flow to OpenCV block-matching.
// - g2o + Vis/CorFlowUseMinEigenVals=false: keeps optical flow but
// drops the min-eigenvalue error metric (uses L1-patch instead).
// - g2o + stereoToDepth: SensorCaptureThread::postUpdate() converts
// each stereo frame into RGB-D (dense disparity -> depth) before
// odometry runs, exercising rtabmap's RGB-D path on stereo data.
struct Variant {
Optimizer::Type opt;
const char * label;
ParametersMap extraOdom;
bool stereoToDepth;
};
const std::vector<Variant> variants = {
{Optimizer::kTypeG2O, "g2o", {}, false},
{Optimizer::kTypeGTSAM, "gtsam", {}, false},
{Optimizer::kTypeCeres, "ceres", {}, false},
{Optimizer::kTypeG2O, "g2o_no_optical_flow",
{{Parameters::kStereoOpticalFlow(), "false"}}, false},
{Optimizer::kTypeG2O, "g2o_no_min_eigenvals",
{{Parameters::kVisCorFlowUseMinEigenVals(), "false"}}, false},
{Optimizer::kTypeG2O, "g2o_stereo_to_depth", {}, true },
};
int variantsTested = 0;
for(const Variant & v : variants)
{
if(!Optimizer::isAvailable(v.opt))
{
std::cerr << "[skip] optimizer " << v.label << " not available\n";
continue;
}
SCOPED_TRACE(std::string("variant=") + v.label);
const std::string strategy = uNumber2Str(static_cast<int>(v.opt));
ParametersMap rtabmapParams = baseRtabmapParams();
rtabmapParams[Parameters::kMemUseOdomFeatures()] = "true";
// 1035 frames at 20 Hz — throttle rtabmap to 2 Hz; odometry
// still runs on every frame.
rtabmapParams[Parameters::kRtabmapDetectionRate()] = "2";
// Match every BA-capable knob to the chosen backend: graph
// optimization (Optimizer/Strategy), the local odom BA
// (OdomF2M/BundleAdjustment), and the visual-registration BA
// used during loop closure verification (Vis/BundleAdjustment).
rtabmapParams[Parameters::kOptimizerStrategy()] = strategy;
rtabmapParams[Parameters::kVisBundleAdjustment()] = strategy;
ParametersMap odomParams = baseOdometryParams();
odomParams[Parameters::kOdomF2MBundleAdjustment()] = strategy;
// Apply per-variant odometry overrides (Stereo/OpticalFlow, ...).
// Last write wins, so this overrides anything from baseOdometryParams.
for(const auto & kv : v.extraOdom)
{
odomParams[kv.first] = kv.second;
// Vis/* knobs apply to both odom and rtabmap; mirror them
// so loop-closure verification uses the same setting.
if(kv.first.rfind("Vis/", 0) == 0)
{
rtabmapParams[kv.first] = kv.second;
}
}
const ReplayResult result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/false,
/*passOdomDataToRtabmap=*/true,
/*goldenStampedGroundTruth=*/nullptr,
/*frameStride=*/1,
/*runLabel=*/v.label,
/*stereoToDepth=*/v.stereoToDepth);
EXPECT_GT(result.framesRead, 1000)
<< v.label << ": expected ~1035 frames from stereo_20Hz.db";
EXPECT_EQ(0, result.odomLost)
<< v.label << ": stereo odometry should not lose tracking";
EXPECT_GE(result.loopClosuresAccepted, 1)
<< v.label << ": expected at least one loop closure";
EXPECT_GT(result.finalGlobalGraphSize, 0);
float tRmse=0, tMean=0, tMed=0, tStd=0, tMin=0, tMax=0;
float rRmse=0, rMean=0, rMed=0, rStd=0, rMin=0, rMax=0;
graph::calcRMSE(goldenPoses, result.finalGlobalPoses,
tRmse, tMean, tMed, tStd, tMin, tMax,
rRmse, rMean, rMed, rStd, rMin, rMax,
/*align2D=*/false);
std::cerr << "[" << v.label << "] trans rmse=" << tRmse << "m max="
<< tMax << "m, rot rmse=" << rRmse << "deg max="
<< rMax << "deg\n";
// Golden is BA-optimized; the test runs only the real-time SLAM
// pipeline with the matching BA backend, so the natural gap to
// the golden is wider than a run-to-run comparison would be.
// Bounds sit at ~2x the worst observed across all six variants
// (worst trans=0.076 m on ceres, worst rot=1.40 deg on gtsam)
EXPECT_LT(tRmse, 0.15f)
<< v.label << " translational RMSE drifted vs golden";
EXPECT_LT(rRmse, 3.0f)
<< v.label << " rotational RMSE drifted vs golden";
++variantsTested;
}
ASSERT_GT(variantsTested, 0) << "no BA-capable optimizer was available";
}
// ---------------------------------------------------------------------------
// PR2 2D-laser + RGB-D sample (~15s).
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, PR2_Scan2D_RGBD)
{
const std::string dbPath = testDataPath("pr2_scan2d_rgbd_sample_15s.db");
SKIP_IF_MISSING(dbPath);
// Iterate over the BA-capable optimizers built into this rtabmap.
struct Variant { Optimizer::Type opt; const char * label; };
const std::vector<Variant> variants = {
{Optimizer::kTypeG2O, "g2o" },
{Optimizer::kTypeGTSAM, "gtsam"},
{Optimizer::kTypeCeres, "ceres"},
};
int variantsTested = 0;
for(const Variant & v : variants)
{
if(!Optimizer::isAvailable(v.opt))
{
std::cerr << "[skip] optimizer " << v.label << " not available\n";
continue;
}
SCOPED_TRACE(std::string("variant=") + v.label);
const std::string strategy = uNumber2Str(static_cast<int>(v.opt));
ParametersMap rtabmapParams = baseRtabmapParams();
rtabmapParams[Parameters::kMemUseOdomFeatures()] = "true";
rtabmapParams[Parameters::kOptimizerStrategy()] = strategy;
rtabmapParams[Parameters::kVisBundleAdjustment()] = strategy;
ParametersMap odomParams = baseOdometryParams();
odomParams[Parameters::kOdomF2MBundleAdjustment()] = strategy;
// passOdomDataToRtabmap=true: rtabmap reuses the keypoints/descriptors
// extracted during odometry (paired with Mem/UseOdomFeatures=true above).
const ReplayResult result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/false,
/*passOdomDataToRtabmap=*/true,
/*goldenStampedGroundTruth=*/nullptr,
/*frameStride=*/1,
/*runLabel=*/v.label);
EXPECT_GT(result.framesRead, 0);
EXPECT_EQ(0, result.odomLost)
<< v.label << ": Odometry should never lose tracking";
EXPECT_EQ(21, result.finalGlobalGraphSize) << v.label;
EXPECT_GE(result.proximityDetections, 1)
<< v.label << ": PR2 2D-scan dataset should produce proximity detections";
EXPECT_GE(result.gridEmptyCells, 2200) << v.label;
EXPECT_LE(result.gridEmptyCells, 3400) << v.label;
EXPECT_GE(result.gridObstacleCells, 4200) << v.label;
EXPECT_LE(result.gridObstacleCells, 5400) << v.label;
#ifdef RTABMAP_OCTOMAP
EXPECT_GE(result.octomapEmptyCells, 5500) << v.label;
EXPECT_LE(result.octomapEmptyCells, 10500) << v.label;
EXPECT_GE(result.octomapObstacleCells, 38000) << v.label;
EXPECT_LE(result.octomapObstacleCells, 50000) << v.label;
#endif
// RGB-D F2M visual odom + visual loop closure -- observed RMSE ~13 cm
// (less stable than the stereo/ICP paths), 20 cm bound gives ~50%
// headroom for visual-only loop-closure variability.
ASSERT_GE(result.translationalRmseFinal, 0.0f)
<< v.label << ": No Gt/translational_rmse in stats (ground truth missing?)";
EXPECT_LT(result.translationalRmseFinal, 0.20f)
<< v.label << " Final trajectory RMSE = " << result.translationalRmseFinal << " m";
++variantsTested;
}
ASSERT_GT(variantsTested, 0) << "no BA-capable optimizer was available";
}
// ---------------------------------------------------------------------------
// Same PR2 RGB-D sample as above but run through the scan-based ICP loop
// closure pipeline (Reg/Strategy=1 + RGBD/Proximity*) instead of the default
// visual registration. Exercises the 2D-laser proximity path with 3DoF
// constraint.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, PR2_Scan2D_RGBD_IcpReg)
{
const std::string dbPath = testDataPath("pr2_scan2d_rgbd_sample_15s.db");
SKIP_IF_MISSING(dbPath);
ParametersMap rtabmapParams = baseRtabmapParams();
rtabmapParams[Parameters::kGridRangeMax()] = "0";
rtabmapParams[Parameters::kGridSensor()] = "0";
rtabmapParams[Parameters::kIcpCorrespondenceRatio()] = "0.10";
rtabmapParams[Parameters::kIcpEpsilon()] = "0.001";
rtabmapParams[Parameters::kIcpMaxTranslation()] = "0.5";
// See Netherdrone test comment: OutlierRatio is backend-dependent.
#ifdef RTABMAP_POINTMATCHER
rtabmapParams[Parameters::kIcpOutlierRatio()] = "0.95";
#else
rtabmapParams[Parameters::kIcpOutlierRatio()] = "0.85";
#endif
rtabmapParams[Parameters::kIcpPointToPlane()] = "true";
rtabmapParams[Parameters::kIcpVoxelSize()] = "0.0";
rtabmapParams[Parameters::kMemBinDataKept()] = "true";
rtabmapParams[Parameters::kMemLaserScanNormalK()] = "5";
rtabmapParams[Parameters::kMemLaserScanNormalRadius()] = "1";
rtabmapParams[Parameters::kMemLaserScanVoxelSize()] = "0.05";
rtabmapParams[Parameters::kRGBDProximityPathFilteringRadius()] = "1";
rtabmapParams[Parameters::kRGBDProximityPathMaxNeighbors()] = "10";
rtabmapParams[Parameters::kRegForce3DoF()] = "true";
rtabmapParams[Parameters::kRegStrategy()] = "1";
// Odometry inherits all rtabmap params, then overrides for odom-side ICP
// and motion guess.
ParametersMap odomParams = rtabmapParams;
odomParams[Parameters::kIcpPointToPlaneRadius()] = "1";
odomParams[Parameters::kIcpVoxelSize()] = "0.05";
odomParams[Parameters::kOdomGuessMotion()] = "true";
odomParams[Parameters::kOdomStrategy()] = "0";
const ReplayResult result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/true);
EXPECT_GT(result.framesRead, 0);
EXPECT_EQ(0, result.odomLost) << "Odometry should never lose tracking";
EXPECT_EQ(21, result.finalGlobalGraphSize);
EXPECT_GE(result.proximityDetections, 1)
<< "PR2 2D-scan dataset should produce proximity detections";
// Observed: empty 22785-24111, obstacle 1302-1637. Range widened to
// absorb run-to-run variance from the RANSAC correspondence rejector
// installed in the PCL ICP path (util3d_registration.cpp).
EXPECT_GE(result.gridEmptyCells, 22500);
EXPECT_LE(result.gridEmptyCells, 24500);
EXPECT_GE(result.gridObstacleCells, 1250);
EXPECT_LE(result.gridObstacleCells, 1700);
#ifdef RTABMAP_OCTOMAP
// 2D-laser-only signatures: nothing to assemble into a 3D OctoMap.
EXPECT_EQ(0, result.octomapEmptyCells);
EXPECT_EQ(0, result.octomapObstacleCells);
#endif
// Scan-based ICP loop closure with the PR2's 2D laser should align the
// final trajectory to within ~6 cm of the stored ground truth. Typical
// observations: Linux ~0.015-0.02 m, macOS ~0.045 m, with occasional
// Linux outliers up to ~0.054 m from the RANSAC correspondence rejector
// in the PCL ICP path.
ASSERT_GE(result.translationalRmseFinal, 0.0f)
<< "No Gt/translational_rmse in stats (ground truth missing?)";
EXPECT_LT(result.translationalRmseFinal, 0.06f)
<< "Final trajectory RMSE = " << result.translationalRmseFinal << " m";
}
// ---------------------------------------------------------------------------
// PR2 2D-laser corridor traversal (~50s). Three replay variants exercising
// every entry point into Rtabmap's ICP path (Reg/Strategy=1):
// own-odom : DB odom ignored, ICP-F2M odometry runs from scratch.
// guess-odom : DB odom delta supplied as motion guess to ICP-F2M odometry.
// stored-odom : DB odom fed straight to Rtabmap, no odometry stage at all.
// The corridor's long-axis degeneracy makes this a useful regression check
// for the low-complexity fallback + ICP loop closure on 2D scans.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, PR2_Scan2D_Corridor_IcpReg)
{
const std::string dbPath = testDataPath("pr2_scan2d_corridor_50s.db");
SKIP_IF_MISSING(dbPath);
enum class OdomMode { OwnOdom, GuessFromDb, StoredOdomDirect };
struct Variant { const char * label; OdomMode mode; float scanMaxRange; };
const std::vector<Variant> variants = {
{"own-odom", OdomMode::OwnOdom, 0.0f},
{"guess-odom", OdomMode::GuessFromDb, 0.0f},
{"stored-odom", OdomMode::StoredOdomDirect, 0.0f},
{"own-odom-range5.6", OdomMode::OwnOdom, 5.6f},
{"guess-odom-range5.6", OdomMode::GuessFromDb, 5.6f},
{"stored-odom-range5.6", OdomMode::StoredOdomDirect, 5.6f},
};
auto buildRtabmapParams = []() {
ParametersMap p = baseRtabmapParams();
// 1 Hz detection rate; throttled frames become intermediate nodes
// (id=-1) so the full 990-frame odom track + laser payloads are
// preserved in the output DB for offline inspection.
p[Parameters::kRtabmapDetectionRate()] = "1";
p[Parameters::kRtabmapCreateIntermediateNodes()] = "true";
p[Parameters::kMemIntermediateNodeDataKept()] = "true";
p[Parameters::kRegStrategy()] = "1";
p[Parameters::kRegForce3DoF()] = "true";
p[Parameters::kRGBDCreateOccupancyGrid()] = "false";
p[Parameters::kIcpEpsilon()] = "0.001";
p[Parameters::kIcpMaxTranslation()] = "0.5";
p[Parameters::kIcpCorrespondenceRatio()] = "0.01";
p[Parameters::kIcpPointToPlane()] = "true";
p[Parameters::kIcpVoxelSize()] = "0.0";
#ifdef RTABMAP_POINTMATCHER
p[Parameters::kIcpOutlierRatio()] = "0.95";
p[Parameters::kIcpStrategy()] = "1"; // libpointmatcher
#else
p[Parameters::kIcpOutlierRatio()] = "0.85";
#endif
p[Parameters::kMemBinDataKept()] = "true";
p[Parameters::kMemLaserScanNormalK()] = "5";
p[Parameters::kMemLaserScanNormalRadius()] = "1";
p[Parameters::kMemLaserScanVoxelSize()] = "0.05";
p[Parameters::kRGBDProximityPathFilteringRadius()] = "1";
p[Parameters::kRGBDProximityPathMaxNeighbors()] = "10";
return p;
};
for(const Variant & v : variants)
{
SCOPED_TRACE(std::string("variant=") + v.label);
ParametersMap rtabmapParams = buildRtabmapParams();
ReplayResult result;
if(v.mode == OdomMode::StoredOdomDirect)
{
rtabmapParams[Parameters::kRGBDNeighborLinkRefining()] = "true";
const std::string workDb = test::tempPath(uFormat(
"rtabmap_integration_PR2_Scan2D_Corridor_IcpReg_%s.db", v.label));
result = replayDatabaseWithStoredOdom(dbPath, workDb, rtabmapParams,
/*triggerNewMapAfterFrame=*/-1,
/*overrideOdomAngularVariance=*/-1.0,
/*overrideOdomLinearVariance=*/-1.0,
/*scanMaxRange=*/v.scanMaxRange);
}
else
{
ParametersMap odomParams = rtabmapParams;
odomParams[Parameters::kOdomStrategy()] = "0"; // F2M
odomParams[Parameters::kOdomGuessMotion()] = "true";
odomParams[Parameters::kIcpPointToPlaneRadius()] = "1";
odomParams[Parameters::kIcpVoxelSize()] = "0.05";
const bool useGuess = (v.mode == OdomMode::GuessFromDb);
result = replayDatabase(dbPath, rtabmapParams, odomParams,
/*useStoredOdomAsGuess=*/useGuess,
/*passOdomDataToRtabmap=*/false,
/*goldenStampedGroundTruth=*/nullptr,
/*frameStride=*/1,
/*runLabel=*/v.label,
/*stereoToDepth=*/false,
/*scanMaxRange=*/v.scanMaxRange);
}
EXPECT_EQ(990, result.framesRead)
<< v.label << ": expected 990 frames in the corridor DB";
if(v.scanMaxRange > 0.0f)
{
// Range-capped variants: even when the lidar sees only 5.6 m
// of corridor, the default low-complexity strategy
// (Icp/PointToPlaneLowComplexityStrategy=1: PointToPoint +
// project) keeps libpointmatcher's iteration inside the
// Icp/MaxTranslation bound, so ICP odometry never loses
// tracking. All three modes build a complete ~48-node graph.
EXPECT_NEAR(48, result.framesProcessed, 3) << v.label;
// All 990 DB frames live in the graph: 48 detection nodes +
// 942 intermediate nodes (Rtabmap/CreateIntermediateNodes).
EXPECT_NEAR(942, result.framesIntermediate, 5) << v.label;
EXPECT_EQ(990, result.finalGlobalGraphSize) << v.label;
ASSERT_GE(result.translationalRmseFinal, 0.0f) << v.label;
if(v.mode != OdomMode::StoredOdomDirect)
{
EXPECT_EQ(0, result.odomLost) << v.label
<< ": no odom loss expected under the range cap with the "
<< "default PointToPoint-low-complexity recovery strategy";
}
if(v.mode == OdomMode::OwnOdom)
{
// The 5.6 m range cap leaves the corridor's long axis
// unobservable, so ICP-F2M's error along it is a random
// walk rather than a stable quantity. Four consecutive
// runs on one libpointmatcher build gave
// 0.20/0.19/0.48/0.26 m, yet macOS -- also
// libpointmatcher -- has reached 2.56 m and ubuntu-26
// (PCL ICP, which logs "Not enough correspondences" on
// this data) 3.47 m. A 13x spread within one backend
// says the ICP implementation is not the driver, so this
// is deliberately NOT split per backend the way the
// full-scan own-odom bound is.
//
// Successive platforms pushed the observed max 1.5 ->
// 2.56 -> 3.47 m, so a bound tracking the latest sample
// just fails on the next new platform (2.0 m already
// did). What this variant actually regression-tests is
// the block above: odometry never loses tracking under
// the cap, and all 990 frames still land in a complete
// ~48-node graph. The RMSE check is therefore only a
// divergence catch, set near half the DB's 24.2 m
// ground-truth path length (per rtabmap-report): a
// genuinely broken ICP leaves odometry near-static,
// which puts error on the order of the full path, while
// unobservable-axis drift stays well under it.
EXPECT_LT(result.translationalRmseFinal, 10.0f)
<< v.label << " RMSE = " << result.translationalRmseFinal << "m";
}
else if(v.mode == OdomMode::GuessFromDb)
{
// Observed ~0.05 m at 5.6 m range -- DB odom guess holds
// the trajectory while ICP refines y/yaw.
EXPECT_LT(result.translationalRmseFinal, 0.15f)
<< v.label << " RMSE = " << result.translationalRmseFinal << "m";
}
else // StoredOdomDirect
{
// Observed ~0.04 m at 5.6 m range; stored odom carries
// the trajectory, short scans don't propagate into error.
EXPECT_LT(result.translationalRmseFinal, 0.10f)
<< v.label << " RMSE = " << result.translationalRmseFinal << "m";
}
}
else
{
// 1 Hz throttle on 50s of data -> ~48-50 nodes regardless of
// mode (odom always runs on every DB frame, rtabmap.process is
// the one that gates on DetectionRate).
EXPECT_NEAR(48, result.framesProcessed, 3) << v.label;
// All 990 DB frames live in the graph: 48 detection nodes +
// 942 intermediate nodes (Rtabmap/CreateIntermediateNodes).
EXPECT_NEAR(942, result.framesIntermediate, 5) << v.label;
EXPECT_EQ(990, result.finalGlobalGraphSize) << v.label;
// Corridor's tight viewpoint spacing -> near-1:1 node-to-proximity
// ratio (observed 43/48).
EXPECT_GE(result.proximityDetections, 35) << v.label;
// Stored ground truth + 3DoF ICP. With recorded-odom guidance
// (guess / stored variants) RMSE stays around 3 cm; pure
// ICP-F2M (own-odom) drifts more, ~8 cm on macOS CI runs,
// so it gets a looser bound.
//
// own-odom is also the one variant whose bound depends on which
// ICP backend was compiled in, because buildRtabmapParams() above
// selects libpointmatcher (Icp/Strategy=1, OutlierRatio 0.95) or
// falls back to PCL ICP (OutlierRatio 0.85) on the same #ifdef.
// Those are different algorithms, and with no odom guess to lean
// on their drift over 990 corridor frames differs: the ROS lyrical
// and rolling CI jobs rosdep-skip libpointmatcher and land at
// ~0.158 m where libpointmatcher builds sit near 0.03-0.08 m. Give
// the PCL path its own band rather than relaxing both -- otherwise
// the libpointmatcher builds stop guarding their real level.
//
// The PCL path is reproducible enough to bound tightly: lyrical
// and rolling -- different distros, different Eigen/PCL -- agree to
// 5 significant digits (0.158479 / 0.158477), so 0.18 leaves room
// for a platform that shifts it slightly while still failing on a
// real drift regression.
ASSERT_GE(result.translationalRmseFinal, 0.0f)
<< v.label << ": no Gt/translational_rmse in stats";
#ifdef RTABMAP_POINTMATCHER
const float ownOdomRmseBound = 0.15f;
#else
const float ownOdomRmseBound = 0.18f;
#endif
const float rmseBound =
(v.mode == OdomMode::OwnOdom) ? ownOdomRmseBound : 0.06f;
EXPECT_LT(result.translationalRmseFinal, rmseBound)
<< v.label << " RMSE = " << result.translationalRmseFinal << "m";
if(v.mode != OdomMode::StoredOdomDirect)
{
EXPECT_EQ(0, result.odomLost)
<< v.label << ": odometry should never lose tracking";
}
}
}
}
// ---------------------------------------------------------------------------
// Two-loop workspace mapping session (Texture tutorial DB). Loads the
// pre-built session, runs global bundle adjustment, and asserts the
// resulting poses against a captured golden trajectory.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, TwoLoopsWorkspaceGlobalBA)
{
const std::string srcPath = testDataPath("2loops_workspace_3IT.db");
SKIP_IF_MISSING(srcPath);
// Golden trajectory was captured from a known-good BA run, verified
// in rtabmap-databaseViewer, then exported to
// data/tests/2loops_workspace_3IT_gt.g2o. To regenerate after a
// deliberate BA-algorithm change: rerun BA on the source DB, eyeball
// it in the viewer, and re-export the graph from there.
const std::string goldenPath = testDataPath("2loops_workspace_3IT_gt.g2o");
std::map<int, Transform> goldenPoses;
std::multimap<int, Link> goldenLinks;
ASSERT_TRUE(graph::importPoses(goldenPath, /*format=*/4, goldenPoses, &goldenLinks))
<< "Failed to load golden poses from " << goldenPath;
// Variant matrix:
// * g2o is the primary backend, exercised across both rematchFeatures
// settings and with detectMoreLoopClosures enabled.
// * gtsam and ceres are validated only on the simplest config
// (no rematch, no extra loop-closure detection) to keep the test
// fast while still catching regressions in those backends.
// cvsba is excluded — observed ~4× worse RMSE on this dataset.
//
// Per-variant RMSE bounds: g2o and gtsam (SBA-style) converge to the
// same tight optimum on this dataset across versions; ceres trails
// slightly on some ceres-solver releases, so its bound is loosened
// just enough to absorb cross-version drift without masking real
// regressions (still asserts BA improved the pre-BA RMSE).
struct Variant {
Optimizer::Type type;
const char * name;
bool rematch;
bool detectMore;
float maxTRmse;
float maxRRmse;
};
const std::vector<Variant> variants = {
{Optimizer::kTypeG2O, "g2o", false, true, 0.05f, 1.5f },
{Optimizer::kTypeG2O, "g2o-rematch", true, true, 0.05f, 1.5f },
{Optimizer::kTypeGTSAM, "gtsam", false, false, 0.05f, 1.5f },
{Optimizer::kTypeCeres, "ceres", false, false, 0.07f, 2.5f },
};
int variantsTested = 0;
for(const Variant & v : variants)
{
if(!Optimizer::isAvailable(v.type))
{
std::cerr << "[skip] optimizer " << v.name << " not available in this build\n";
continue;
}
SCOPED_TRACE(std::string("variant=") + v.name);
// Open the source DB read-only. BA runs entirely against
// _optimizedPoses in working memory, so no writes hit the DB; the
// readonly flag also prevents accidental persistence if a future
// change adds a write path.
ParametersMap params;
uInsert(params, ParametersPair(Parameters::kMemIncrementalMemory(), "false"));
uInsert(params, ParametersPair(Parameters::kMemLocalizationReadOnly(), "true"));
Rtabmap rtabmap;
rtabmap.init(params, srcPath, /*loadDatabaseParameters=*/true);
std::map<int, Transform> initPoses;
std::multimap<int, Link> initLinks;
rtabmap.getGraph(initPoses, initLinks, /*optimized=*/true, /*global=*/false);
const int linksBeforeDetect = static_cast<int>(initLinks.size());
if(v.detectMore)
{
// In read-only mode any new links live in working memory only;
// the source DB is untouched.
const int added = rtabmap.detectMoreLoopClosures(
/*clusterRadiusMax=*/1.0f,
/*clusterAngle=*/static_cast<float>(CV_PI)/6.0f,
/*iterations=*/3,
/*intraSession=*/true);
ASSERT_GE(added, 0) << v.name << " detectMoreLoopClosures failed";
std::map<int, Transform> postDetectPoses;
std::multimap<int, Link> postDetectLinks;
rtabmap.getGraph(postDetectPoses, postDetectLinks,
/*optimized=*/true, /*global=*/false);
std::cerr << "[" << v.name << "] links: " << linksBeforeDetect
<< " -> " << postDetectLinks.size()
<< " (detectMoreLoopClosures added " << added << ")\n";
EXPECT_GT((int)postDetectLinks.size(), linksBeforeDetect)
<< v.name << " detectMoreLoopClosures did not increase link count";
}
// Snapshot the graph right before BA — for variants without
// detectMoreLoopClosures this is the original graph; for variants
// with it, the snapshot includes the newly-added closures.
std::map<int, Transform> preBaPoses;
std::multimap<int, Link> preBaLinks;
rtabmap.getGraph(preBaPoses, preBaLinks, /*optimized=*/true, /*global=*/false);
float preTRmse=0, tMeanPre=0, tMedPre=0, tStdPre=0, tMinPre=0, tMaxPre=0;
float rRmsePre=0, rMeanPre=0, rMedPre=0, rStdPre=0, rMinPre=0, rMaxPre=0;
graph::calcRMSE(goldenPoses, preBaPoses,
preTRmse, tMeanPre, tMedPre, tStdPre, tMinPre, tMaxPre,
rRmsePre, rMeanPre, rMedPre, rStdPre, rMinPre, rMaxPre,
/*align2D=*/false);
std::cerr << "[" << v.name << "] Pre-BA: "
<< "trans rmse=" << preTRmse << "m max=" << tMaxPre << "m, "
<< "rot rmse=" << rRmsePre << "deg max=" << rMaxPre << "deg\n";
const bool baOk = rtabmap.globalBundleAdjustment(
/*optimizerType=*/v.type,
/*rematchFeatures=*/v.rematch,
/*iterations=*/30,
/*pixelVariance=*/0.0f);
ASSERT_TRUE(baOk) << "globalBundleAdjustment failed for " << v.name;
std::map<int, Transform> poses;
std::multimap<int, Link> links;
// global=false reads BA poses straight from _optimizedPoses;
// global=true would re-run pose-graph optimization and clobber BA.
rtabmap.getGraph(poses, links, /*optimized=*/true, /*global=*/false);
// DB is read-only — close without attempting to write back.
rtabmap.close(false);
ASSERT_EQ(poses.size(), goldenPoses.size())
<< v.name << " BA result has " << poses.size()
<< " poses, golden has " << goldenPoses.size();
// SVD-aligned RMSE — golden was captured with different BA
// settings, so a Umeyama-style alignment is what's meaningful.
float tRmse=0, tMean=0, tMed=0, tStd=0, tMin=0, tMax=0;
float rRmse=0, rMean=0, rMed=0, rStd=0, rMin=0, rMax=0;
graph::calcRMSE(goldenPoses, poses,
tRmse, tMean, tMed, tStd, tMin, tMax,
rRmse, rMean, rMed, rStd, rMin, rMax,
/*align2D=*/false);
std::cerr << "[" << v.name << "] BA: "
<< "trans rmse=" << tRmse << "m max=" << tMax << "m, "
<< "rot rmse=" << rRmse << "deg max=" << rMax << "deg\n";
EXPECT_GT(preTRmse, tRmse)
<< v.name << " BA did not improve translational RMSE";
EXPECT_LT(tRmse, v.maxTRmse)
<< v.name << " translational RMSE too large after alignment";
EXPECT_LT(rRmse, v.maxRRmse)
<< v.name << " rotational RMSE too large after alignment";
++variantsTested;
}
ASSERT_GT(variantsTested, 0) << "no BA-capable optimizer was available";
}
// ---------------------------------------------------------------------------
// Robust-graph-optimization tutorial DB (stereo). Replays the session frame
// by frame, feeding the stored odom pose straight to Rtabmap (no odometry
// recomputation). Sweeps the 2x2x2 grid:
// Optimizer/Strategy in {g2o, GTSAM}
// Optimizer/Robust in {true, false}
// RGBD/OptimizeMaxError in {3.0, 0.0}
// The full robust combo (g2o + Robust=true + MaxError=3) is the golden;
// runs with both safeguards off should produce a visibly wrong graph.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, RobustGraphOptimizationStereo)
{
const std::string srcPath = testDataPath("robust_graph_optimization_stereo.db");
SKIP_IF_MISSING(srcPath);
if(!Optimizer::isAvailable(Optimizer::kTypeG2O)
&& !Optimizer::isAvailable(Optimizer::kTypeGTSAM))
{
GTEST_SKIP() << "neither g2o nor gtsam built — this test exercises both";
}
struct Variant {
Optimizer::Type optType;
bool robust;
float maxError;
const char * label;
};
// g2o and gtsam each cover both robust/no-robust at the default
// MaxError=3. Ceres is skipped here — it doesn't implement Vertigo
// switches (Optimizer/Robust=true), so it can't exercise the robust
// path that's the point of this DB.
const std::vector<Variant> variants = {
{Optimizer::kTypeG2O, true, 3.0f, "g2o-robust-maxerr3" },
{Optimizer::kTypeG2O, false, 3.0f, "g2o-norobust-maxerr3" },
{Optimizer::kTypeGTSAM, true, 3.0f, "gtsam-robust-maxerr3" },
{Optimizer::kTypeGTSAM, false, 3.0f, "gtsam-norobust-maxerr3" },
};
// Golden trajectory captured from the g2o-robust-maxerr3 variant and
// committed under data/tests/. Regenerate by uncommenting the
// exportPoses block below and rerunning the test.
const std::string goldenPath = testDataPath("robust_graph_optimization_stereo_gt.g2o");
std::map<int, Transform> goldenPoses;
std::multimap<int, Link> goldenLinks;
ASSERT_TRUE(graph::importPoses(
goldenPath, /*format=*/4, goldenPoses, &goldenLinks))
<< "Failed to load golden poses from " << goldenPath;
int variantsTested = 0;
for(const Variant & v : variants)
{
if(!Optimizer::isAvailable(v.optType))
{
std::cerr << "[skip] " << v.label << " (optimizer unavailable)\n";
continue;
}
SCOPED_TRACE(std::string(v.label));
ParametersMap params = baseRtabmapParams();
uInsert(params, ParametersPair(Parameters::kOptimizerStrategy(),
uNumber2Str(static_cast<int>(v.optType))));
uInsert(params, ParametersPair(Parameters::kOptimizerRobust(),
v.robust ? "true" : "false"));
uInsert(params, ParametersPair(Parameters::kRGBDOptimizeMaxError(),
uNumber2Str(v.maxError)));
uInsert(params, ParametersPair(Parameters::kMemUseOdomFeatures(), "true"));
uInsert(params, ParametersPair(Parameters::kRGBDCreateOccupancyGrid(), "false"));
uInsert(params, ParametersPair(Parameters::kMemBinDataKept(), "false"));
uInsert(params, ParametersPair(Parameters::kKpFlannRebalancingFactor(), "1"));
uInsert(params, ParametersPair(Parameters::kRtabmapDetectionRate(), "0"));
const std::string workDb = test::tempPath(uFormat(
"rtabmap_integration_RobustGraphOptimizationStereo_%s.db", v.label));
std::cerr << "Working DB for " << v.label << ": " << workDb << "\n";
const ReplayResult result =
replayDatabaseWithStoredOdom(srcPath, workDb, params);
// Sanity: every variant must produce some optimized graph.
ASSERT_GT(result.framesProcessed, 0) << v.label << " produced no frames";
ASSERT_GT(result.finalGlobalGraphSize, 0)
<< v.label << " produced empty graph";
// Regenerate golden from the most robust combo. Toggled on for a
// one-shot capture; re-comment after the file is committed.
// if(v.optType == Optimizer::kTypeG2O && v.robust && v.maxError > 0.0f)
// {
// std::multimap<int, Link> links;
// rtabmap::graph::exportPoses(goldenPath, /*format=*/4,
// result.finalGlobalPoses, links);
// }
float tRmse=0, tMean=0, tMed=0, tStd=0, tMin=0, tMax=0;
float rRmse=0, rMean=0, rMed=0, rStd=0, rMin=0, rMax=0;
graph::calcRMSE(goldenPoses, result.finalGlobalPoses,
tRmse, tMean, tMed, tStd, tMin, tMax,
rRmse, rMean, rMed, rStd, rMin, rMax,
/*align2D=*/false);
std::cerr << "[" << v.label << "] "
<< "trans rmse=" << tRmse << "m max=" << tMax << "m, "
<< "rot rmse=" << rRmse << "deg max=" << rMax << "deg\n";
// Each remaining variant enables at least one safeguard
// (Optimizer/Robust or RGBD/OptimizeMaxError) and should land
// close to the golden trajectory. The "neither safeguard"
// (norobust+maxerr=0) cases are removed since their
// catastrophic-drift behavior is already established.
EXPECT_LT(tRmse, 0.05f)
<< v.label << " translational RMSE too large; "
<< "expected near golden";
EXPECT_LT(rRmse, 1.5f)
<< v.label << " rotational RMSE too large; "
<< "expected near golden";
++variantsTested;
}
ASSERT_GT(variantsTested, 0) << "no compatible optimizer was available";
}
// ---------------------------------------------------------------------------
// 3-iteration loop with GPS metadata. Replays the session frame-by-frame
// with the stored odom, sweeping Rtabmap/LoopGPS on/off. GPS-aided loop
// closure detection filters candidates by GPS proximity; with it off the
// detector falls back to the visual-only pipeline. The golden trajectory
// is captured with GPS on.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, Loop3ItGps)
{
const std::string srcPath = testDataPath("loop_3it_gps.db");
SKIP_IF_MISSING(srcPath);
const bool hasGtsam = Optimizer::isAvailable(Optimizer::kTypeGTSAM);
const bool hasG2o = Optimizer::isAvailable(Optimizer::kTypeG2O);
if(!hasGtsam && !hasG2o)
{
GTEST_SKIP() << "neither gtsam nor g2o built — this test needs at least one";
}
// Prefer gtsam: this DB's hard-GPS-priors path is well-behaved under
// gtsam but catastrophically rejects all loops under g2o.
const Optimizer::Type backend = hasGtsam
? Optimizer::kTypeGTSAM : Optimizer::kTypeG2O;
struct Variant {
Optimizer::Type optType;
bool loopGps;
int triggerNewMapAfterFrame; // -1 = single session
bool robust;
float maxError;
bool priorsIgnored; // false = use GPS priors as anchors
std::string label;
};
// Default MaxError + Optimizer/Robust=false. Single-session variants
// are the canonical comparison against the golden; the newmap@60
// variants exercise the multi-session path. The trailing "-priors"
// variants flip Optimizer/PriorsIgnored=false so the GPS pose-prior
// links anchor the trajectory.
const int kTriggerFrame = 60;
const std::vector<Variant> variants = {
{backend, true, -1, false, 3.0f, true, "gps-on" },
{backend, false, -1, false, 3.0f, true, "gps-off" },
{backend, true, kTriggerFrame, false, 3.0f, true, "gps-on-newmap60" },
{backend, false, kTriggerFrame, false, 3.0f, true, "gps-off-newmap60" },
{backend, true, -1, false, 3.0f, false, "gps-on-priors" },
{backend, true, kTriggerFrame, false, 3.0f, false, "gps-on-newmap60-priors" },
};
// Golden trajectory captured from the gps-on variant and committed
// under data/tests/. Regenerate by uncommenting the exportPoses block
// below and rerunning the test.
const std::string goldenPath = testDataPath("loop_3it_gps_gt.g2o");
std::map<int, Transform> goldenPoses;
std::multimap<int, Link> goldenLinks;
ASSERT_TRUE(graph::importPoses(
goldenPath, /*format=*/4, goldenPoses, &goldenLinks))
<< "Failed to load golden poses from " << goldenPath;
for(const Variant & v : variants)
{
// gps-on-priors only converges on this DB with gtsam — g2o
// hard-anchors the noisy GPS priors and rejects every visual
// loop closure, collapsing the trajectory to ~30 m. Skip it
// on g2o-only builds rather than encoding two different
// expected outcomes.
if(v.label == "gps-on-priors" && !hasGtsam)
{
std::cerr << "[skip] " << v.label
<< ": requires gtsam (g2o-only path is catastrophic)\n";
continue;
}
SCOPED_TRACE(std::string(v.label));
ParametersMap params = baseRtabmapParams();
uInsert(params, ParametersPair(Parameters::kOptimizerStrategy(),
uNumber2Str(static_cast<int>(v.optType))));
uInsert(params, ParametersPair(Parameters::kRtabmapLoopGPS(),
v.loopGps ? "true" : "false"));
uInsert(params, ParametersPair(Parameters::kOptimizerRobust(),
v.robust ? "true" : "false"));
uInsert(params, ParametersPair(Parameters::kRGBDOptimizeMaxError(),
uNumber2Str(v.maxError)));
uInsert(params, ParametersPair(Parameters::kOptimizerPriorsIgnored(),
v.priorsIgnored ? "true" : "false"));
uInsert(params, ParametersPair(Parameters::kMemUseOdomFeatures(), "true"));
uInsert(params, ParametersPair(Parameters::kRGBDCreateOccupancyGrid(), "false"));
uInsert(params, ParametersPair(Parameters::kMemBinDataKept(), "false"));
uInsert(params, ParametersPair(Parameters::kKpFlannRebalancingFactor(), "1"));
uInsert(params, ParametersPair(Parameters::kRtabmapDetectionRate(), "0"));
const std::string workDb = test::tempPath(uFormat(
"rtabmap_integration_Loop3ItGps_%s.db", v.label.c_str()));
std::cerr << "Working DB for " << v.label << ": " << workDb << "\n";
const ReplayResult result = replayDatabaseWithStoredOdom(
srcPath, workDb, params, v.triggerNewMapAfterFrame);
ASSERT_GT(result.framesProcessed, 0) << v.label << " produced no frames";
ASSERT_GT(result.finalGlobalGraphSize, 0)
<< v.label << " produced empty graph";
float tRmse=0, tMean=0, tMed=0, tStd=0, tMin=0, tMax=0;
float rRmse=0, rMean=0, rMed=0, rStd=0, rMin=0, rMax=0;
graph::calcRMSE(goldenPoses, result.finalGlobalPoses,
tRmse, tMean, tMed, tStd, tMin, tMax,
rRmse, rMean, rMed, rStd, rMin, rMax,
/*align2D=*/false);
std::cerr << "[" << v.label << "] "
<< "trans rmse=" << tRmse << "m max=" << tMax << "m, "
<< "rot rmse=" << rRmse << "deg max=" << rMax << "deg, "
<< "loops=" << result.loopClosuresAccepted
<< " rejected=" << result.loopClosuresRejected << "\n";
// RMSE bands by configuration (observed on gtsam):
// * Single-session, priors-ignored: ~15 cm
// * Single-session with GPS priors: ~0.6 m (gtsam balances
// visual loops vs noisy priors; g2o would catastrophically
// fail this case and is skipped above).
// * newmap60 with GPS bridging: ~1 m
// * newmap60 with GPS + hard priors: ~2.5 m
// * newmap60 without GPS bridging: ~30 m (no anchor).
const bool gpsOffAndNewMap =
!v.loopGps && v.triggerNewMapAfterFrame > 0;
const bool singleSessionWithHardPriors =
v.triggerNewMapAfterFrame < 0 && !v.priorsIgnored;
const bool newMapWithHardPriors =
v.triggerNewMapAfterFrame > 0 && !v.priorsIgnored;
if(gpsOffAndNewMap)
{
EXPECT_GT(tRmse, 20.0f)
<< v.label << " expected to blow up (no usable anchor)";
}
else if(singleSessionWithHardPriors)
{
// gtsam balances noisy GPS priors against visual loops; the
// solution is platform-numerics-sensitive (Eigen + BLAS path):
// Linux/macOS land around 0.6 m, Windows up to ~2.3 m, and ROS
// kilted (newer Eigen/gtsam) sits at the Windows end (~2.3 m).
EXPECT_LT(tRmse, 3.0f)
<< v.label << " single-session with priors should "
<< "stay below ~3 m (gtsam balances priors vs loops)";
}
else if(newMapWithHardPriors)
{
EXPECT_LT(tRmse, 4.0f)
<< v.label << " newmap60 + priors should stay below ~4 m";
}
else if(v.triggerNewMapAfterFrame < 0)
{
EXPECT_LT(tRmse, 0.30f)
<< v.label << " single-session RMSE drifted";
}
else
{
EXPECT_LT(tRmse, 2.0f)
<< v.label << " session-split RMSE should stay bounded";
}
// Loop closure counts (accepted/rejected):
// * GPS-off rejects more than GPS-on (no GPS pre-filter, more
// candidates reach the MaxError gate).
// * newmap60 rejects more than single-session (the artificial
// split makes cross-session candidates more error-prone).
// One observed sample on this DB (without Optimizer/Robust):
// gps-on : 19 accepted / 2 rejected
// gps-off : 13 accepted / 18 rejected
// gps-on-newmap60 : 24 accepted / 17 rejected
// gps-off-newmap60 : 16 accepted / 41 rejected
int minAcc, maxAcc, minRej, maxRej;
if(!v.loopGps && v.triggerNewMapAfterFrame > 0)
{
minAcc = 5; maxAcc = 30;
minRej = 30; maxRej = 100; // gps-off + newmap60
}
else if(!v.loopGps)
{
minAcc = 5; maxAcc = 25;
minRej = 5; maxRej = 40; // gps-off single
}
else if(v.triggerNewMapAfterFrame < 0 && !v.priorsIgnored)
{
// gtsam balances hard GPS priors against visual loop
// closures and keeps most loops. Observed ~21 accepted /
// ~8 rejected.
//
// The accepted count here is as platform-numerics-sensitive as
// the RMSE band above, and for the same reason: the optimized
// solution feeds the RGBD/OptimizeMaxError gate, so wherever
// gtsam strikes a different prior-vs-loop balance a different
// subset of candidates survives. ROS kilted lands 8 accepted /
// 10 rejected with rmse 2.3 m -- the Windows-like end of the
// documented spread, not a collapse. So this floor cannot be
// set from the 0.6 m-solution count; 5 keeps the check as a
// collapse detector (g2o's failure mode is ~0 loops and ~30 m,
// which the RMSE assert above is what actually catches).
minAcc = 5; maxAcc = 35;
minRej = 0; maxRej = 25; // gps-on single + priors (gtsam)
}
else if(v.triggerNewMapAfterFrame > 0 && !v.priorsIgnored)
{
// newmap60 + priors: the session split + GPS priors push
// loops past the MaxError gate more often. Observed ~9
// accepted / ~32 rejected.
minAcc = 2; maxAcc = 20;
minRej = 20; maxRej = 60; // gps-on newmap60 + priors
}
else if(v.triggerNewMapAfterFrame > 0)
{
minAcc = 10; maxAcc = 40;
minRej = 5; maxRej = 40; // gps-on newmap60
}
else
{
minAcc = 10; maxAcc = 35;
minRej = 0; maxRej = 20; // gps-on single
}
EXPECT_GE(result.loopClosuresAccepted, minAcc)
<< v.label << " accepted fewer loops than expected";
EXPECT_LE(result.loopClosuresAccepted, maxAcc)
<< v.label << " accepted more loops than expected";
EXPECT_GE(result.loopClosuresRejected, minRej)
<< v.label << " rejected fewer loops than expected";
EXPECT_LE(result.loopClosuresRejected, maxRej)
<< v.label << " rejected more loops than expected";
// Smoke check: every variant produces *some* trajectory.
EXPECT_GT(result.finalGlobalGraphSize, 100)
<< v.label << " produced an unexpectedly small graph";
}
}
// ---------------------------------------------------------------------------
// Appearance-only loop closure on the 84-image `data/samples` set with the
// shipped `data/samples_GT.bmp` ground truth. Measures recall at 100%
// precision (the rtabmap "max recall while no false positive has appeared
// yet" metric — same definition as the legacy MATLAB getPrecisionRecall.m
// script) for every Features2D detector strategy that is available in this
// build. Detector strategies for which Feature2D::create() silently
// substitutes a different backend (e.g. SURF -> SIFT without nonfree,
// SuperPointTorch -> GFTT/ORB without RTABMAP_TORCH) are skipped.
// ---------------------------------------------------------------------------
TEST_F(RtabmapIntegrationFixture, AppearanceOnly_PrecisionRecall)
{
const std::string samplesDir = std::string(RTABMAP_TEST_DATA_ROOT) + "/samples";
const std::string gtPath = std::string(RTABMAP_TEST_DATA_ROOT) + "/samples_GT.bmp";
SKIP_IF_MISSING(samplesDir);
SKIP_IF_MISSING(gtPath);
// 84x84 binary loop-closure ground truth. Pixel (i, j) == 255 means
// query frame i+1 has a true loop with past frame j+1. The
// gray-pixel "ignore" zone the MATLAB script handles is not present
// in this GT (only 0 / 255), so we skip that branch.
cv::Mat gt = cv::imread(gtPath, cv::IMREAD_GRAYSCALE);
ASSERT_EQ(84, gt.rows) << "unexpected samples_GT.bmp size";
ASSERT_EQ(84, gt.cols) << "unexpected samples_GT.bmp size";
const int kNumFrames = 84;
// Total GT positives = number of query rows with at least one true
// loop. Recall denominator in the standard rtabmap metric.
int gtTotalPositives = 0;
for(int i = 0; i < gt.rows; ++i)
{
for(int j = 0; j < gt.cols; ++j)
{
if(gt.at<unsigned char>(i, j) == 255)
{
++gtTotalPositives;
break;
}
}
}
ASSERT_GT(gtTotalPositives, 0) << "samples_GT.bmp has no positives";
// Iterate every backend listed in Feature2D::Type. kFeatureEnd is the
// sentinel kept at the back of the enum so a new strategy gets covered
// here automatically.
// SuperPoint asset paths. SuperPointTorch needs a pre-traced *.pt
// (produced by scripts/fetch_test_data.sh from *.pth when torch is
// installed). The Rpautrat backend takes the *.pth directly and traces
// to *.pt at runtime inside the C++ class, so we point it at the .pth
// + the python model file the runtime tracer needs.
const std::string superpointTorchModel = std::string(RTABMAP_TEST_DATA_ROOT) + "/tests/superpoint_v1.pt";
const std::string superpointRpautratWeights = std::string(RTABMAP_TEST_DATA_ROOT) + "/tests/superpoint_v6_from_tf.pth";
const std::string superpointRpautratModel = std::string(RTABMAP_TEST_DATA_ROOT) + "/tests/superpoint_pytorch.py";
// One pass per detector: prefer GPU if available, otherwise CPU. To
// keep wall-clock low, the two BoW likelihood variants (default raw
// word-count vs TF-IDF-weighted) are exercised only on rtabmap's
// default detector (Kp/DetectorStrategy default = kFeatureGfttOrb).
const Feature2D::Type defaultDetector =
static_cast<Feature2D::Type>(Parameters::defaultKpDetectorStrategy());
int detectorsTested = 0;
// Tracks whether any detector × variant across the whole test produced
// a bad signature that still carried non-empty word-keypoints. Asserted
// at the end so the BadSignatures path is verified at least once
// regardless of which detectors are available in this build.
// The idea is that we should test that in case of bad signatures,
// the keypoints AND descriptors should be generated (#1717).
bool sawBadSigWithKpts = false;
for(int strategy = Feature2D::kFeatureSurf; strategy < Feature2D::kFeatureEnd; ++strategy)
{
const Feature2D::Type detectorType = static_cast<Feature2D::Type>(strategy);
const std::string typeName = Feature2D::typeName(detectorType);
if(!Feature2D::isAvailable(detectorType))
{
std::cerr << "[skip] detector " << typeName << " not available in this build\n";
continue;
}
if(detectorType == Feature2D::kFeaturePyDetector)
{
std::cerr << "[skip] detector " << typeName
<< " requires a user-supplied Py/DetectorPath script\n";
continue;
}
// SuperPoint variants need traced *.pt weights (plus a Python
// model file for the Rpautrat backend). The fetch_test_data.sh
// script writes them under data/tests/; skip cleanly if absent.
if(detectorType == Feature2D::kFeatureSuperPointTorch && !UFile::exists(superpointTorchModel))
{
std::cerr << "[skip] detector " << typeName
<< " missing weights: " << superpointTorchModel
<< " (run scripts/fetch_test_data.sh)\n";
continue;
}
if(detectorType == Feature2D::kFeatureSuperPointRpautrat &&
(!UFile::exists(superpointRpautratWeights) ||
!UFile::exists(superpointRpautratModel)))
{
std::cerr << "[skip] detector " << typeName
<< " missing assets: weights=" << superpointRpautratWeights
<< " model=" << superpointRpautratModel
<< " (run scripts/fetch_test_data.sh)\n";
continue;
}
// Probe GPU availability once per detector. Build the temp instance
// with the same asset paths the actual run uses; otherwise SuperPoint
// variants log a (harmless) load failure.
bool gpuAvailable = false;
{
ParametersMap probeParams;
if(detectorType == Feature2D::kFeatureSuperPointTorch)
{
probeParams[Parameters::kSuperPointModelPath()] = superpointTorchModel;
}
else if(detectorType == Feature2D::kFeatureSuperPointRpautrat)
{
probeParams[Parameters::kSuperPointRpautratWeightsPath()] = superpointRpautratWeights;
probeParams[Parameters::kSuperPointRpautratModelPath()] = superpointRpautratModel;
}
std::unique_ptr<Feature2D> probe(Feature2D::create(detectorType, probeParams));
if(probe) gpuAvailable = probe->isGpuAvailable();
}
// GPU-capable detectors are exercised twice (CPU + GPU) so both code
// paths stay covered. Detectors that don't report a GPU path run only
// once.
std::vector<bool> gpuVariants = {false};
if(gpuAvailable) gpuVariants.push_back(true);
// Run only the default likelihood variant for every detector;
// the TF-IDF variant adds a second run on the default detector
// (kFeatureGfttOrb) so the alternative likelihood path stays
// exercised without quadrupling the test runtime.
std::vector<bool> tfIdfVariants = {false};
if(detectorType == defaultDetector) tfIdfVariants.push_back(true);
for(bool useGpu : gpuVariants)
for(bool tfIdfUsed : tfIdfVariants)
{
const std::string detectorLabel = typeName
+ (tfIdfUsed ? "[TfIdf]" : "[Likelihood]")
+ (useGpu ? "[GPU]" : "");
SCOPED_TRACE(std::string("detector=") + detectorLabel);
ParametersMap params;
params[Parameters::kRGBDEnabled()] = "false";
params[Parameters::kKpDetectorStrategy()] = uNumber2Str(static_cast<int>(detectorType));
params[Parameters::kSURFHessianThreshold()] = "150";
params[Parameters::kMemSTMSize()] = "20";
params[Parameters::kKpTfIdfLikelihoodUsed()] = tfIdfUsed ? "true" : "false";
params[Parameters::kKpMaxFeatures()] = "500";
params[Parameters::kKpBadSignRatio()] = "0.1";
params[Parameters::kKpNndrRatio()] = "0.8";
// SIFT-specific: lower the contrast threshold so more keypoints
// survive on the low-texture frames in data/samples.
params[Parameters::kSIFTContrastThreshold()] = "0.01";
// BRISK-specific: lower FAST threshold so the detector keeps more
// candidates per frame; default is too strict for this dataset.
params[Parameters::kBRISKThresh()] = "10";
// KAZE-specific: drop the response threshold an order of magnitude
// so more (weaker) keypoints survive on the low-texture frames.
params[Parameters::kKAZEThreshold()] = "0.0001";
// GFTT-specific: tighten the minimum keypoint separation (default
// 7 px) so more candidates fit per frame.
params[Parameters::kGFTTMinDistance()] = "3";
params[Parameters::kMemBadSignaturesIgnored()] = "false";
params[Parameters::kMemRehearsalSimilarity()] = "0.20";
params[Parameters::kBRIEFBytes()] = "64";
// Backend-specific asset paths + GPU/CUDA toggle. `useGpu` only
// reaches here when this detector reports a usable GPU path; we
// then flip the per-detector "use GPU" parameter on.
const std::string gpuFlag = useGpu ? "true" : "false";
if(detectorType == Feature2D::kFeatureSuperPointTorch)
{
params[Parameters::kSuperPointModelPath()] = superpointTorchModel;
params[Parameters::kSuperPointCuda()] = gpuFlag;
}
else if(detectorType == Feature2D::kFeatureSuperPointRpautrat)
{
params[Parameters::kSuperPointRpautratWeightsPath()] = superpointRpautratWeights;
params[Parameters::kSuperPointRpautratModelPath()] = superpointRpautratModel;
params[Parameters::kSuperPointRpautratCuda()] = gpuFlag;
}
else if(useGpu)
{
switch(detectorType)
{
case Feature2D::kFeatureSurf: params[Parameters::kSURFGpuVersion()] = "true"; break;
case Feature2D::kFeatureSift: params[Parameters::kSIFTGpu()] = "true"; break;
case Feature2D::kFeatureOrb: params[Parameters::kORBGpu()] = "true"; break;
case Feature2D::kFeatureGfttFreak:
case Feature2D::kFeatureGfttBrief:
case Feature2D::kFeatureGfttOrb:
case Feature2D::kFeatureGfttDaisy: params[Parameters::kGFTTGpu()] = "true"; break;
default: break;
}
}
const std::string workDb = workDbForCurrentTest(detectorLabel);
UFile::erase(workDb);
Rtabmap rtabmap;
rtabmap.init(params, workDb);
struct FrameStat {
int queryRow; // 0-based query frame index
double hypValue; // rtabmap.getHighestHypothesisValue()
int hypId; // rtabmap.getHighestHypothesisId() (1-based, 0 = none)
bool accepted; // rtabmap.getLoopClosureId() > 0
bool correct; // GT[queryRow][hypId-1] == 255
bool gtPositive; // any GT[queryRow][*] == 255
};
std::vector<FrameStat> stats;
stats.reserve(kNumFrames);
CameraImages camera(samplesDir);
ASSERT_TRUE(camera.init()) << "CameraImages.init() failed on " << samplesDir;
UTimer wall;
int i = 0;
int badSignatureCount = 0;
SensorData data = camera.takeImage();
while(!data.imageRaw().empty())
{
++i;
data.setId(i);
data.setStamp(static_cast<double>(i));
const bool ok = rtabmap.process(data, Transform());
ASSERT_TRUE(ok) << detectorLabel << " rtabmap.process failed at frame " << i;
// Per-frame checks on the just-processed signature in
// working memory:
// * verify keypoints and descriptors stay 1-to-1 (no row
// silently dropped during BOW quantization),
// * count bad signatures (low-texture frames on this
// 84-image set produce a handful with
// Mem/BadSignaturesIgnored=false; rehearsal does not
// merge bad signatures, so the per-frame count is stable).
const Signature * lastSig =
rtabmap.getMemory()->getLastWorkingSignature(false);
ASSERT_TRUE(lastSig != nullptr)
<< detectorLabel << " frame " << i << ": no last signature";
EXPECT_EQ(static_cast<int>(lastSig->getWordsKpts().size()),
lastSig->getWordsDescriptors().rows)
<< detectorLabel << " frame " << i
<< " (id=" << lastSig->id() << "): keypoints/descriptors "
<< "size mismatch on signature ("
<< lastSig->getWordsKpts().size() << " vs "
<< lastSig->getWordsDescriptors().rows << ")";
if(lastSig->isBadSignature())
{
++badSignatureCount;
if(!lastSig->getWordsKpts().empty())
{
sawBadSigWithKpts = true;
}
}
FrameStat s;
s.queryRow = i - 1;
s.hypValue = rtabmap.getHighestHypothesisValue();
s.hypId = rtabmap.getHighestHypothesisId();
s.accepted = rtabmap.getLoopClosureId() > 0;
s.gtPositive = false;
for(int j = 0; j < gt.cols; ++j)
{
if(gt.at<unsigned char>(s.queryRow, j) == 255)
{
s.gtPositive = true;
break;
}
}
s.correct = false;
if(s.hypId > 0 && s.hypId - 1 < gt.cols)
{
s.correct = gt.at<unsigned char>(s.queryRow, s.hypId - 1) == 255;
}
stats.push_back(s);
data = camera.takeImage();
}
ASSERT_EQ(kNumFrames, i)
<< detectorLabel << " expected " << kNumFrames
<< " frames from " << samplesDir << ", got " << i;
std::cerr << "[" << detectorLabel
<< "] bad signatures: " << badSignatureCount
<< " (Mem/BadSignaturesIgnored=false)\n";
// Pick the descriptor type from the last in-memory signature to
// drive the recall-floor logic below (binary vs float bucket).
bool binaryDescriptors = false;
{
const Signature * lastSig =
rtabmap.getMemory()->getLastWorkingSignature(false);
if(lastSig && !lastSig->getWordsDescriptors().empty())
{
binaryDescriptors =
lastSig->getWordsDescriptors().type() == CV_8U;
}
}
rtabmap.close();
// Standard rtabmap P/R curve: sort frames by hypothesis value
// descending and walk down; precision = correct hypotheses so far
// divided by total hypotheses so far, recall = correct so far over
// gtTotalPositives. "Recall at 100% precision" is the recall at
// the last point before the first FP appears.
std::vector<FrameStat> sorted = stats;
std::sort(sorted.begin(), sorted.end(),
[](const FrameStat & a, const FrameStat & b){
return a.hypValue > b.hypValue;
});
int tp = 0, fp = 0;
float recallAt100p = 0.0f;
float thrAt100p = 0.0f;
bool seenFp = false;
for(const FrameStat & s : sorted)
{
if(s.hypId <= 0 || s.hypValue <= 0.0)
{
continue; // no hypothesis at all this frame
}
if(s.correct)
{
++tp;
if(!seenFp)
{
recallAt100p = float(tp) / float(gtTotalPositives);
thrAt100p = static_cast<float>(s.hypValue);
}
}
else
{
if(!seenFp)
{
// One-shot diagnostic: the first FP is what gates
// recall@100%P. Print the (query, matched) pair so we
// can eyeball whether it's a true mismatch or just a
// visually-similar frame the GT happens not to flag.
std::cerr << "[" << detectorLabel << "] first-FP query="
<< (s.queryRow + 1)
<< " matched=" << s.hypId
<< " hypValue=" << s.hypValue
<< " (TPs above this point=" << tp << ")\n";
}
++fp;
seenFp = true;
}
}
// Also report end-of-run precision/recall at the default rtabmap
// loop threshold (i.e. counting only accepted closures) -- closer
// to what a real deployment would observe.
int acceptedTp = 0, acceptedFp = 0, acceptedFn = 0;
for(const FrameStat & s : stats)
{
if(s.accepted && s.correct) ++acceptedTp;
else if(s.accepted && !s.correct) ++acceptedFp;
else if(s.gtPositive) ++acceptedFn;
}
const float acceptedPrec = (acceptedTp + acceptedFp) > 0
? float(acceptedTp) / float(acceptedTp + acceptedFp) : 0.0f;
const float acceptedRec = gtTotalPositives > 0
? float(acceptedTp) / float(gtTotalPositives) : 0.0f;
// Dump the accepted loops as a 84x84 binary matrix in the same
// shape as samples_GT.bmp (pixel (query, loop) = 255 when rtabmap
// accepted that closure) so the run is easy to diff visually
// against the ground truth.
cv::Mat detectionsMat = cv::Mat::zeros(kNumFrames, kNumFrames, CV_8UC1);
for(const FrameStat & s : stats)
{
if(s.accepted && s.hypId > 0
&& s.hypId - 1 < detectionsMat.cols
&& s.queryRow < detectionsMat.rows)
{
detectionsMat.at<unsigned char>(s.queryRow, s.hypId - 1) = 255;
}
}
std::string safeLabel = detectorLabel;
for(char & c : safeLabel)
{
if(c == '+' || c == '/' || c == ' ' || c == '\\'
|| c == '[' || c == ']') c = '_';
}
const std::string detectionsBmp = test::tempPath(uFormat(
"rtabmap_integration_AppearanceOnly_%s_loops.bmp", safeLabel.c_str()));
cv::imwrite(detectionsBmp, detectionsMat);
std::cerr << "[" << detectorLabel << "] loop-closure matrix -> "
<< detectionsBmp << "\n";
std::cerr << "[" << detectorLabel << "]"
<< " gtPos=" << gtTotalPositives
<< " sortedTP=" << tp << " sortedFP=" << fp
<< " recall@100%P=" << recallAt100p << " (thr=" << thrAt100p << ")"
<< " accepted: tp=" << acceptedTp << " fp=" << acceptedFp
<< " prec=" << acceptedPrec << " recall=" << acceptedRec
<< " wall=" << wall.elapsed() << "s\n";
if(acceptedTp + acceptedFp == 0)
{
std::cerr << "[" << detectorLabel << "] note: no loop closure accepted "
"at default threshold (sortedTP=" << tp << ", sortedFP=" << fp
<< ")\n";
}
const bool daisyDescriptor =
detectorType == Feature2D::kFeatureGfttDaisy ||
detectorType == Feature2D::kFeatureSurfDaisy;
const bool freakOrBriefDescriptor =
detectorType == Feature2D::kFeatureFastFreak ||
detectorType == Feature2D::kFeatureFastBrief ||
detectorType == Feature2D::kFeatureGfttFreak ||
detectorType == Feature2D::kFeatureGfttBrief ||
detectorType == Feature2D::kFeatureSurfFreak;
const bool looseFloors = binaryDescriptors || daisyDescriptor;
const bool xfeatures2dDescriptor = freakOrBriefDescriptor || daisyDescriptor;
const float kMinPrecision = tfIdfUsed ? 0.70f :
(looseFloors ? 0.85f : 0.9f);
const float kMinRecall = xfeatures2dDescriptor ? 0.5f :
(looseFloors ? 0.7f : 0.85f);
EXPECT_GE(acceptedPrec, kMinPrecision)
<< detectorLabel << " accepted precision=" << acceptedPrec
<< " is below " << kMinPrecision
<< " (tp=" << acceptedTp << ", fp=" << acceptedFp << ")";
EXPECT_GE(acceptedRec, kMinRecall)
<< detectorLabel << " accepted recall=" << acceptedRec
<< " is below " << kMinRecall
<< " (tp=" << acceptedTp << ", gtPositives=" << gtTotalPositives
<< ", missed=" << acceptedFn << ")";
++detectorsTested;
} // end for(tfIdfUsed)
}
ASSERT_GT(detectorsTested, 0) << "no Features2D detector was available in this build";
// Across every detector × variant we exercised, at least one bad
// signature must have been observed with non-empty word-keypoints --
// otherwise the BadSignatures path was never genuinely triggered by
// the data and the test setup has drifted away from validating it.
EXPECT_TRUE(sawBadSigWithKpts)
<< "no bad signature with non-empty words-keypoints was seen "
<< "across any detector; data/samples or the BoW pipeline may "
<< "no longer be exercising the BadSignatures path";
}