mirror of
https://github.com/introlab/rtabmap.git
synced 2026-10-06 01:57:45 +08:00
* added doc and tests for util2d.h * updated cmake-ros ci * Added util3d.h doc and tests * util3d_transforms.h: Added doc and tests * util3d_filtering.h: started doc and test * util3d_filtering.h: more tests and doc * Added more doc/tests * finished util3d_filtering doc and tests * added test for util2d::depthBleedingFiltering * Added util3d_registration tests * Added util3d_features.h doc/tests * added doc/tests for util3d_correspondences.h * added doc/gtest for util3d_mapping.h (missing hpp functions) * finished testing util3d_mapping.hpp * Added util3d_motion_estimation.h tests (2D->3D done) * finished util3d_motion_estimation.h tests * minimal util3d_surface.h * Added Transform and VisualWord tests * Added doc for CameraModel and StereoCameraModel * Added more logs in ros ci * Passing tests on fical * improved all devcontainer * added devcontainer kilted, fixed source setup.bash, removed ldconfig in ros-cmake workflow * cleanup * source ros * Added utilite tests * Added testing to appveyor, github actions cancellable on re-commit on same branch * appveyor testing without all targets * appveyor: specifying ALL_BUILD target * Fixed Util2dTest.NMSImageBoundsRespected test * Fixing PCL Indices error on old pcl * Added VWDictionary tests and doc. Fixed LSH not working (fix from https://github.com/flann-lib/flann/pull/472 * fixing some appveyor CI errors, added test to check dictionary serialization against all type * Added StereoDense, StereoBM and StereoSGBM doc and tests * Added Stereo tests * Added CameraModel and StereoCameraModel tests * Added doc and test for Statistics * Added doc/tests for Signature * Added doc/test for SensorEvent, added doc for SensorCaptureInfo * Added doc to SensorData * Added SensorData tests * Added SensorCapture and SensorCaptureThread doc and tests * fixed sensordata test * updated SSC test and doc * Added doc and tests for BayesFilter class * Enabled testing on mac, updated windows testing like on linux * added test_link * fixed unresolved on windows * fixed ThreadHandle error on macos ci * Added GPS and GeodeticCoords tests * Added tests for compression * Added Odometry tests (base class only) * Added DBDriver tests * Added coverage report * uniformized test names * fixing concurancy and coverage ci * dont built tools, examples and app for coverage build * fixed report tool rebuilt without qt compilation error * updated coverage option * updated coverage config * added doc CI job * fixing windows and mac ci errors * Added DBDriverSqlite3 tests * Added IMU tests * Added Graph tests * fixing flaky macos test * Added IMUThread and IMUFilter tests * Added Landmarks tests * Added LASWriter tests * fixing seed flaky test * fixing flaky macos timing tests * Added LocalGrid tests * Added LocalGridMaker tests * fixing ci errors * Added GlobalMap tests * Added doc for EnvSensor * Added Features2D tests * Added Registration tests * Added RegistrationVis tests * Added doc for Rtabmap and Memory classes * Added Memory and Rtabmap tests * making some tests less flaky * lcov 1.14 support * updated compatible tool arguments * Added integration tests (RGB-D, Stereo, Lidar2d, Lidar3d) * More octomap checks * Refactored how/when python interpretor is created to simplify library usage * Added python tests * fixed some flaky tests * suppressed some third party related warnings * fixed ceres tests * more flaky fixes * Fixing tests without libpointmatcher * Added RANSAC rejection filter to PCL ICP * fixing multi platform flakiness * Added test to detect regression * Fixing windows pcl link error * fixed some macos flakiness * bigger 2D2D registration error on opencv 4.6.0 * flakiness * fixing flaky tests on windows and mac * flaky thread test on slow mac VM * windows slow test * fixing more ci erros * fxing temp dir on windows * Added Optimizer tests and discovered some bugs (fixed) * fixing flaky tests in mac and windows * Added Optimizer doc * Added GTSAM BA, updated Ceres to use g2o ba parameters. Renamed g2o's ba related parameters to Optimizer group and used by both gtsam and ceres. * fixing build without gtsam * fixing home dir * fixing python ci isssues * Added multicam ba tests * Added Ceres multicam BA support * Aligned BundleAdjustment parameters with Optimizer/Strategy to avoid confusion in the code * Added BA integration test * Added robust graph optimization integration test * Added loop3it test * Added stereo20Hz test * Added smartfactor gtsam * Fixed bugged check and warn if python didn't return any descriptors * Fixing gtsam version build issues * fixing tilt on windows ci * loosing ceres integration test for ci * mac ci flakiness * updating missing param in gui * updating test bound for mac * added appearance-based tests, set min gftt quality to quality level * testing more stuff * improving features2d tests * ci flakiness * fixing flaky ci * ci fixes * flaky fixes * Added RegistrationIcp tests * Added icp integration test with real-worl corridor like env * intermediate nodes * fixing enum * Updated test to catch #1714 * Fixed 2d corridor failing on pcl * flaky pnp test * flaky brisk test * Set rtabmap_integration test as long * updating loop closure test * flaky ci tests * TEsting roundtrip g2o/toro save/load * loosing test bound * fixed cuda capable checks * flaky tests * Debugging test hanging * more debugging stuff * updating limit * windows: disabled cuda on ci to avoid incompatible driver issue. Fixing a bad test mem allocation * trying fixing cuda hanging issue * fixing ci flakyness * flaky tests * Updated BOW flaky tests by checking min precision/recall instead of recall@100precision. Fixed signature test * CameraModel::load() test initRectificationMap param * test dbdriver load dictionary idsOnly * Memory: test keepLinkedInDb param * added dummyDictionary tests * test intermediate nodes count * Added MarkerDetector tests * reverted breaking change of UMutex and USemaphore * Features2d: fixed compiltion warnings with clang about override * clang warnings * fixing test build with pcl 1.8 * g2o and gtsam build errors on android * opencv5 test fixes * disabled testing for ios and android builds * normalized endline characters for easier diff * added LF CRLF rule * bump 0.23.10. fixing doc version * Publish rtabmap website doc from ci * fixing MSCVC build error * macos icp flaky test * fixing ceres macos test bound * ficing more flaky tests * fixing opencv5 related test errors. Also fixed an actual bug in ENU_WGS84ToGeocentric_WGS84() * added comment about mrpt change * removed rosdoc2 (will add it for rtabmap_ros later) * fixing website style * updated download links * locally deployable website with api * sweep doxygen issues * improved/revised doxygen main pages * removed examples empty page * Updated doxygen style * more concise doxygen groups * added api link on main readme * fixing utilite test error * fixing CommonFilteringGroundNormalsUp test * updated precisionRecall test bounds for Freak and brief descriptors * fixing scale check in ba tests * disabled tests on windows cuda build (missing dlls amd runner cannot test cuda anyway) * ceres: missing suitesparse dep in windows ci * adjusting recall thr for fast/freak * ficing more flaky tests * fixing flaky tests * disabled coverage in ros ci * Enable integration tests for ros ci jobs * loosing up some threshold for failing tests * trigger cache * fixing test data in ros ci. Updated flaky test for mac * slaking some test limit * Fixed rtabmap-detectMoreLoopClosures inverted output value * loosing up sift recall on mac * optimizer re-ordered distribution for reproducible results (mac g2o) * macos dump test crash log * combining all tests to save time on shared library reload. Also fixed Logs with missing arguments. * Added ENABLE_FORMAT_ERRORS cmake option * do test only one time * fixed all format warnings * format security android build errors * less verbose tests * updated ImuUThread test * fixed a log * Fixed libpointmatcher 2d normals eigen issue * Fixing libpointmatcher conversion issues * fixing libpointmatcher test on windows ci * cleanup comments, relax some test thr * disabled sequoia-intel ci build (too flaky, would need extensive testing directly on that machine)
601 lines
22 KiB
C++
601 lines
22 KiB
C++
/*
|
|
Copyright (c) 2010-2016, Mathieu Labbe - IntRoLab - Universite de Sherbrooke
|
|
All rights reserved.
|
|
|
|
Redistribution and use in source and binary forms, with or without
|
|
modification, are permitted provided that the following conditions are met:
|
|
* Redistributions of source code must retain the above copyright
|
|
notice, this list of conditions and the following disclaimer.
|
|
* Redistributions in binary form must reproduce the above copyright
|
|
notice, this list of conditions and the following disclaimer in the
|
|
documentation and/or other materials provided with the distribution.
|
|
* Neither the name of the Universite de Sherbrooke nor the
|
|
names of its contributors may be used to endorse or promote products
|
|
derived from this software without specific prior written permission.
|
|
|
|
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
|
|
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
|
|
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
|
|
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY
|
|
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
|
|
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
|
|
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
|
|
ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
|
|
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
|
|
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
|
*/
|
|
|
|
#include "rtabmap/core/util3d_registration.h"
|
|
|
|
#include "rtabmap/core/util3d_transforms.h"
|
|
#include "rtabmap/core/util3d_filtering.h"
|
|
#include "rtabmap/core/util3d.h"
|
|
|
|
#include <pcl/registration/correspondence_rejection_sample_consensus.h>
|
|
#include <pcl/registration/icp.h>
|
|
|
|
// Explicitly instantiate pcl::RandomSampleConsensus and
|
|
// pcl::SampleConsensusModelRegistration for pcl::PointXYZINormal. PCL itself
|
|
// only ships precompiled symbols for the types listed in PCL_XYZ_POINT_TYPES
|
|
// when built without PCL_ONLY_CORE_POINT_TYPES; the Windows pre-built PCL
|
|
// (and any "core point types" build) omits PointXYZINormal, so without this
|
|
// rtabmap_core.dll fails to link when the rejector is used with that type.
|
|
#include <pcl/sample_consensus/impl/ransac.hpp>
|
|
#include <pcl/sample_consensus/impl/sac_model_registration.hpp>
|
|
template class pcl::RandomSampleConsensus<pcl::PointXYZINormal>;
|
|
template class pcl::SampleConsensusModelRegistration<pcl::PointXYZINormal>;
|
|
|
|
#include <pcl/registration/transformation_estimation_2D.h>
|
|
#include <pcl/registration/transformation_estimation_svd.h>
|
|
#include <pcl/sample_consensus/sac_model_registration.h>
|
|
#include <pcl/sample_consensus/ransac.h>
|
|
#include <pcl/common/common.h>
|
|
#include <rtabmap/utilite/ULogger.h>
|
|
#include <rtabmap/utilite/UMath.h>
|
|
|
|
namespace rtabmap
|
|
{
|
|
|
|
namespace util3d
|
|
{
|
|
|
|
// Get transform from cloud2 to cloud1
|
|
Transform transformFromXYZCorrespondencesSVD(
|
|
const pcl::PointCloud<pcl::PointXYZ> & cloud1,
|
|
const pcl::PointCloud<pcl::PointXYZ> & cloud2)
|
|
{
|
|
UASSERT(cloud1.size() == cloud2.size());
|
|
pcl::registration::TransformationEstimationSVD<pcl::PointXYZ, pcl::PointXYZ> svd;
|
|
|
|
// Perform the alignment
|
|
Eigen::Matrix4f matrix;
|
|
svd.estimateRigidTransformation(cloud1, cloud2, matrix);
|
|
return Transform::fromEigen4f(matrix);
|
|
}
|
|
|
|
// Get transform from cloud2 to cloud1
|
|
Transform transformFromXYZCorrespondences(
|
|
const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloud1,
|
|
const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloud2,
|
|
double inlierThreshold,
|
|
int iterations,
|
|
int refineIterations,
|
|
double refineSigma,
|
|
std::vector<int> * inliersOut,
|
|
cv::Mat * covariance)
|
|
{
|
|
//NOTE: this method is a mix of two methods:
|
|
// - getRemainingCorrespondences() in pcl/registration/impl/correspondence_rejection_sample_consensus.hpp
|
|
// - refineModel() in pcl/sample_consensus/sac.h
|
|
|
|
if(covariance)
|
|
{
|
|
*covariance = cv::Mat::eye(6,6,CV_64FC1);
|
|
}
|
|
Transform transform;
|
|
if(cloud1->size() >=3 && cloud1->size() == cloud2->size())
|
|
{
|
|
// RANSAC
|
|
UDEBUG("iterations=%d inlierThreshold=%f", iterations, inlierThreshold);
|
|
std::vector<int> source_indices (cloud2->size());
|
|
std::vector<int> target_indices (cloud1->size());
|
|
|
|
// Copy the query-match indices
|
|
for (int i = 0; i < (int)cloud1->size(); ++i)
|
|
{
|
|
source_indices[i] = i;
|
|
target_indices[i] = i;
|
|
}
|
|
|
|
// From the set of correspondences found, attempt to remove outliers
|
|
// Create the registration model
|
|
pcl::SampleConsensusModelRegistration<pcl::PointXYZ>::Ptr model;
|
|
model.reset(new pcl::SampleConsensusModelRegistration<pcl::PointXYZ>(cloud2, source_indices));
|
|
// Pass the target_indices
|
|
model->setInputTarget (cloud1, target_indices);
|
|
// Create a RANSAC model
|
|
pcl::RandomSampleConsensus<pcl::PointXYZ> sac (model, inlierThreshold);
|
|
sac.setMaxIterations(iterations);
|
|
|
|
// Compute the set of inliers
|
|
if(sac.computeModel())
|
|
{
|
|
std::vector<int> inliers;
|
|
Eigen::VectorXf model_coefficients;
|
|
|
|
sac.getInliers(inliers);
|
|
sac.getModelCoefficients (model_coefficients);
|
|
|
|
if (refineIterations>0)
|
|
{
|
|
double error_threshold = inlierThreshold;
|
|
int refine_iterations = 0;
|
|
bool inlier_changed = false, oscillating = false;
|
|
std::vector<int> new_inliers, prev_inliers = inliers;
|
|
std::vector<size_t> inliers_sizes;
|
|
Eigen::VectorXf new_model_coefficients = model_coefficients;
|
|
do
|
|
{
|
|
// Optimize the model coefficients
|
|
model->optimizeModelCoefficients (prev_inliers, new_model_coefficients, new_model_coefficients);
|
|
inliers_sizes.push_back (prev_inliers.size ());
|
|
|
|
// Select the new inliers based on the optimized coefficients and new threshold
|
|
model->selectWithinDistance (new_model_coefficients, error_threshold, new_inliers);
|
|
UDEBUG("RANSAC refineModel: Number of inliers found (before/after): %d/%d, with an error threshold of %f.",
|
|
(int)prev_inliers.size (), (int)new_inliers.size (), error_threshold);
|
|
|
|
if (new_inliers.empty ())
|
|
{
|
|
++refine_iterations;
|
|
if (refine_iterations >= refineIterations)
|
|
{
|
|
break;
|
|
}
|
|
continue;
|
|
}
|
|
|
|
// Estimate the variance and the new threshold
|
|
double variance = model->computeVariance ();
|
|
error_threshold = std::min (inlierThreshold, refineSigma * sqrt(variance));
|
|
|
|
UDEBUG ("RANSAC refineModel: New estimated error threshold: %f (variance=%f) on iteration %d out of %d.",
|
|
error_threshold, variance, refine_iterations, refineIterations);
|
|
inlier_changed = false;
|
|
std::swap (prev_inliers, new_inliers);
|
|
|
|
// If the number of inliers changed, then we are still optimizing
|
|
if (new_inliers.size () != prev_inliers.size ())
|
|
{
|
|
// Check if the number of inliers is oscillating in between two values
|
|
if (inliers_sizes.size () >= 4)
|
|
{
|
|
if (inliers_sizes[inliers_sizes.size () - 1] == inliers_sizes[inliers_sizes.size () - 3] &&
|
|
inliers_sizes[inliers_sizes.size () - 2] == inliers_sizes[inliers_sizes.size () - 4])
|
|
{
|
|
oscillating = true;
|
|
break;
|
|
}
|
|
}
|
|
inlier_changed = true;
|
|
continue;
|
|
}
|
|
|
|
// Check the values of the inlier set
|
|
for (size_t i = 0; i < prev_inliers.size (); ++i)
|
|
{
|
|
// If the value of the inliers changed, then we are still optimizing
|
|
if (prev_inliers[i] != new_inliers[i])
|
|
{
|
|
inlier_changed = true;
|
|
break;
|
|
}
|
|
}
|
|
}
|
|
while (inlier_changed && ++refine_iterations < refineIterations);
|
|
|
|
// If the new set of inliers is empty, we didn't do a good job refining
|
|
if (new_inliers.empty ())
|
|
{
|
|
UWARN ("RANSAC refineModel: Refinement failed: got an empty set of inliers!");
|
|
}
|
|
|
|
if (oscillating)
|
|
{
|
|
UDEBUG("RANSAC refineModel: Detected oscillations in the model refinement.");
|
|
}
|
|
|
|
std::swap (inliers, new_inliers);
|
|
model_coefficients = new_model_coefficients;
|
|
}
|
|
|
|
if (inliers.size() >= 3)
|
|
{
|
|
if(inliersOut)
|
|
{
|
|
*inliersOut = inliers;
|
|
}
|
|
if(covariance)
|
|
{
|
|
double variance = model->computeVariance();
|
|
UASSERT(uIsFinite(variance));
|
|
*covariance *= variance + 1e-6;
|
|
}
|
|
|
|
// get best transformation
|
|
Eigen::Matrix4f bestTransformation;
|
|
bestTransformation.row (0) = model_coefficients.segment<4>(0);
|
|
bestTransformation.row (1) = model_coefficients.segment<4>(4);
|
|
bestTransformation.row (2) = model_coefficients.segment<4>(8);
|
|
bestTransformation.row (3) = model_coefficients.segment<4>(12);
|
|
|
|
transform = Transform::fromEigen4f(bestTransformation);
|
|
UDEBUG("RANSAC inliers=%d/%d tf=%s", (int)inliers.size(), (int)cloud1->size(), transform.prettyPrint().c_str());
|
|
|
|
return transform.inverse(); // inverse to get actual pose transform (not correspondences transform)
|
|
}
|
|
else
|
|
{
|
|
UDEBUG("RANSAC: Model with inliers < 3");
|
|
}
|
|
}
|
|
else
|
|
{
|
|
UDEBUG("RANSAC: Failed to find model");
|
|
}
|
|
}
|
|
else
|
|
{
|
|
UDEBUG("Not enough points to compute the transform");
|
|
}
|
|
return Transform();
|
|
}
|
|
|
|
template<typename PointNormalT>
|
|
void computeVarianceAndCorrespondencesImpl(
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & cloudA,
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double maxCorrespondenceAngle,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
variance = 1;
|
|
correspondencesOut = 0;
|
|
typename pcl::registration::CorrespondenceEstimation<PointNormalT, PointNormalT>::Ptr est;
|
|
est.reset(new pcl::registration::CorrespondenceEstimation<PointNormalT, PointNormalT>);
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & target = cloudA->size()>cloudB->size()?cloudA:cloudB;
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & source = cloudA->size()>cloudB->size()?cloudB:cloudA;
|
|
est->setInputTarget(target);
|
|
est->setInputSource(source);
|
|
pcl::Correspondences correspondences;
|
|
if(reciprocal) {
|
|
est->determineReciprocalCorrespondences(correspondences, maxCorrespondenceDistance);
|
|
}
|
|
else {
|
|
est->determineCorrespondences(correspondences, maxCorrespondenceDistance);
|
|
}
|
|
|
|
|
|
if(correspondences.size())
|
|
{
|
|
std::vector<double> distances(correspondences.size());
|
|
correspondencesOut = 0;
|
|
for(unsigned int i=0; i<correspondences.size(); ++i)
|
|
{
|
|
distances[i] = correspondences[i].distance;
|
|
if(maxCorrespondenceAngle <= 0.0)
|
|
{
|
|
++correspondencesOut;
|
|
}
|
|
else
|
|
{
|
|
Eigen::Vector4f v1(
|
|
target->at(correspondences[i].index_match).normal_x,
|
|
target->at(correspondences[i].index_match).normal_y,
|
|
target->at(correspondences[i].index_match).normal_z,
|
|
0);
|
|
Eigen::Vector4f v2(
|
|
source->at(correspondences[i].index_query).normal_x,
|
|
source->at(correspondences[i].index_query).normal_y,
|
|
source->at(correspondences[i].index_query).normal_z,
|
|
0);
|
|
float angle = pcl::getAngle3D(v1, v2);
|
|
if(angle < maxCorrespondenceAngle)
|
|
{
|
|
++correspondencesOut;
|
|
}
|
|
}
|
|
}
|
|
if(correspondencesOut)
|
|
{
|
|
distances.resize(correspondencesOut);
|
|
|
|
//variance
|
|
std::sort(distances.begin (), distances.end ());
|
|
double median_error_sqr = distances[distances.size () >> 1];
|
|
variance = (2.1981 * median_error_sqr);
|
|
}
|
|
}
|
|
}
|
|
|
|
void computeVarianceAndCorrespondences(
|
|
const pcl::PointCloud<pcl::PointNormal>::ConstPtr & cloudA,
|
|
const pcl::PointCloud<pcl::PointNormal>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double maxCorrespondenceAngle,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
computeVarianceAndCorrespondencesImpl<pcl::PointNormal>(cloudA, cloudB, maxCorrespondenceDistance, maxCorrespondenceAngle, variance, correspondencesOut, reciprocal);
|
|
}
|
|
|
|
void computeVarianceAndCorrespondences(
|
|
const pcl::PointCloud<pcl::PointXYZINormal>::ConstPtr & cloudA,
|
|
const pcl::PointCloud<pcl::PointXYZINormal>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double maxCorrespondenceAngle,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
computeVarianceAndCorrespondencesImpl<pcl::PointXYZINormal>(cloudA, cloudB, maxCorrespondenceDistance, maxCorrespondenceAngle, variance, correspondencesOut, reciprocal);
|
|
}
|
|
|
|
template<typename PointT>
|
|
void computeVarianceAndCorrespondencesImpl(
|
|
const typename pcl::PointCloud<PointT>::ConstPtr & cloudA,
|
|
const typename pcl::PointCloud<PointT>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
variance = 1;
|
|
correspondencesOut = 0;
|
|
typename pcl::registration::CorrespondenceEstimation<PointT, PointT>::Ptr est;
|
|
est.reset(new pcl::registration::CorrespondenceEstimation<PointT, PointT>);
|
|
est->setInputTarget(cloudA->size()>cloudB->size()?cloudA:cloudB);
|
|
est->setInputSource(cloudA->size()>cloudB->size()?cloudB:cloudA);
|
|
pcl::Correspondences correspondences;
|
|
if(reciprocal) {
|
|
est->determineReciprocalCorrespondences(correspondences, maxCorrespondenceDistance);
|
|
}
|
|
else {
|
|
est->determineCorrespondences(correspondences, maxCorrespondenceDistance);
|
|
}
|
|
|
|
if(correspondences.size()>=3)
|
|
{
|
|
std::vector<double> distances(correspondences.size());
|
|
for(unsigned int i=0; i<correspondences.size(); ++i)
|
|
{
|
|
distances[i] = correspondences[i].distance;
|
|
}
|
|
|
|
//variance
|
|
std::sort(distances.begin (), distances.end ());
|
|
double median_error_sqr = distances[distances.size () >> 1];
|
|
variance = (2.1981 * median_error_sqr);
|
|
}
|
|
|
|
correspondencesOut = (int)correspondences.size();
|
|
}
|
|
|
|
void computeVarianceAndCorrespondences(
|
|
const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloudA,
|
|
const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
computeVarianceAndCorrespondencesImpl<pcl::PointXYZ>(cloudA, cloudB, maxCorrespondenceDistance, variance, correspondencesOut, reciprocal);
|
|
}
|
|
|
|
void computeVarianceAndCorrespondences(
|
|
const pcl::PointCloud<pcl::PointXYZI>::ConstPtr & cloudA,
|
|
const pcl::PointCloud<pcl::PointXYZI>::ConstPtr & cloudB,
|
|
double maxCorrespondenceDistance,
|
|
double & variance,
|
|
int & correspondencesOut,
|
|
bool reciprocal)
|
|
{
|
|
computeVarianceAndCorrespondencesImpl<pcl::PointXYZI>(cloudA, cloudB, maxCorrespondenceDistance, variance, correspondencesOut, reciprocal);
|
|
}
|
|
|
|
// RANSAC-based correspondence rejector: fits a rigid transform on random
|
|
// 3-pair subsets and discards pairs that disagree. PCL's
|
|
// IterativeClosestPoint::setRANSACOutlierRejectionThreshold and
|
|
// setRANSACIterations are NOT honored by ICP itself (only by NDT and
|
|
// k-4PCS), so we install the rejector explicitly here.
|
|
template<typename PointT>
|
|
void addRansacRejector(
|
|
pcl::IterativeClosestPoint<PointT, PointT> & icp,
|
|
const typename pcl::PointCloud<PointT>::ConstPtr & cloud_source,
|
|
const typename pcl::PointCloud<PointT>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
float ransacOutlierRatio)
|
|
{
|
|
typename pcl::registration::CorrespondenceRejectorSampleConsensus<PointT>::Ptr
|
|
rejector(new pcl::registration::CorrespondenceRejectorSampleConsensus<PointT>());
|
|
rejector->setInlierThreshold(maxCorrespondenceDistance * ransacOutlierRatio);
|
|
rejector->setMaximumIterations(50);
|
|
rejector->setInputSource(cloud_source);
|
|
rejector->setInputTarget(cloud_target);
|
|
icp.addCorrespondenceRejector(rejector);
|
|
}
|
|
|
|
// return transform from source to target (All points must be finite!!!)
|
|
template<typename PointT>
|
|
Transform icpImpl(const typename pcl::PointCloud<PointT>::ConstPtr & cloud_source,
|
|
const typename pcl::PointCloud<PointT>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<PointT> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
pcl::IterativeClosestPoint<PointT, PointT> icp;
|
|
// Set the input source and target
|
|
icp.setInputTarget (cloud_target);
|
|
icp.setInputSource (cloud_source);
|
|
|
|
if(icp2D)
|
|
{
|
|
typename pcl::registration::TransformationEstimation2D<PointT, PointT>::Ptr est;
|
|
est.reset(new pcl::registration::TransformationEstimation2D<PointT, PointT>);
|
|
icp.setTransformationEstimation(est);
|
|
}
|
|
|
|
// Set the max correspondence distance (e.g., correspondences with higher distances will be ignored)
|
|
icp.setMaxCorrespondenceDistance (maxCorrespondenceDistance);
|
|
// Set the maximum number of iterations (criterion 1)
|
|
icp.setMaximumIterations (maximumIterations);
|
|
// Set the transformation epsilon (criterion 2)
|
|
icp.setTransformationEpsilon (epsilon*epsilon);
|
|
// Set the euclidean distance difference epsilon (criterion 3)
|
|
//icp.setEuclideanFitnessEpsilon (-std::numeric_limits<double>::max());
|
|
|
|
if(ransacOutlierRatio > 0.0f && ransacOutlierRatio < 1.0f)
|
|
{
|
|
addRansacRejector<PointT>(icp, cloud_source, cloud_target,
|
|
maxCorrespondenceDistance, ransacOutlierRatio);
|
|
}
|
|
|
|
// Perform the alignment
|
|
icp.align (cloud_source_registered);
|
|
hasConverged = icp.hasConverged();
|
|
if(iterationsDone) *iterationsDone = icp.nr_iterations_;
|
|
return Transform::fromEigen4f(icp.getFinalTransformation());
|
|
}
|
|
|
|
// return transform from source to target (All points must be finite!!!)
|
|
Transform icp(const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloud_source,
|
|
const pcl::PointCloud<pcl::PointXYZ>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<pcl::PointXYZ> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
return icpImpl(cloud_source, cloud_target, maxCorrespondenceDistance, maximumIterations, hasConverged, cloud_source_registered, epsilon, icp2D, ransacOutlierRatio, iterationsDone);
|
|
}
|
|
|
|
// return transform from source to target (All points must be finite!!!)
|
|
Transform icp(const pcl::PointCloud<pcl::PointXYZI>::ConstPtr & cloud_source,
|
|
const pcl::PointCloud<pcl::PointXYZI>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<pcl::PointXYZI> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
return icpImpl(cloud_source, cloud_target, maxCorrespondenceDistance, maximumIterations, hasConverged, cloud_source_registered, epsilon, icp2D, ransacOutlierRatio, iterationsDone);
|
|
}
|
|
|
|
// return transform from source to target (All points/normals must be finite!!!)
|
|
template<typename PointNormalT>
|
|
Transform icpPointToPlaneImpl(
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & cloud_source,
|
|
const typename pcl::PointCloud<PointNormalT>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<PointNormalT> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
pcl::IterativeClosestPoint<PointNormalT, PointNormalT> icp;
|
|
// Set the input source and target
|
|
icp.setInputTarget (cloud_target);
|
|
icp.setInputSource (cloud_source);
|
|
|
|
typename pcl::registration::TransformationEstimationPointToPlaneLLS<PointNormalT, PointNormalT>::Ptr est;
|
|
est.reset(new pcl::registration::TransformationEstimationPointToPlaneLLS<PointNormalT, PointNormalT>);
|
|
icp.setTransformationEstimation(est);
|
|
|
|
// Set the max correspondence distance (e.g., correspondences with higher distances will be ignored)
|
|
icp.setMaxCorrespondenceDistance (maxCorrespondenceDistance);
|
|
// Set the maximum number of iterations (criterion 1)
|
|
icp.setMaximumIterations (maximumIterations);
|
|
// Set the transformation epsilon (criterion 2)
|
|
icp.setTransformationEpsilon (epsilon*epsilon);
|
|
// Set the euclidean distance difference epsilon (criterion 3)
|
|
//icp.setEuclideanFitnessEpsilon (1);
|
|
|
|
if(ransacOutlierRatio > 0.0f && ransacOutlierRatio < 1.0f)
|
|
{
|
|
addRansacRejector<PointNormalT>(icp, cloud_source, cloud_target,
|
|
maxCorrespondenceDistance, ransacOutlierRatio);
|
|
}
|
|
|
|
// Perform the alignment
|
|
icp.align (cloud_source_registered);
|
|
hasConverged = icp.hasConverged();
|
|
if(iterationsDone) *iterationsDone = icp.nr_iterations_;
|
|
Transform t = Transform::fromEigen4f(icp.getFinalTransformation());
|
|
|
|
if(icp2D)
|
|
{
|
|
// PCL has no 2D-aware PointToPlane estimator (only the
|
|
// point-to-point pcl::registration::TransformationEstimation2D),
|
|
// so we run the full 6DoF PointToPlaneLLS above and then snap
|
|
// the result to 3DoF here. The 6DoF LLS on planar (z=0) input
|
|
// is numerically fragile -- callers that need 2D PointToPlane
|
|
// reliably should use libpointmatcher (Icp/Strategy=1).
|
|
t = t.to3DoF();
|
|
pcl::transformPointCloudWithNormals(*cloud_source, cloud_source_registered, t.toEigen4f());
|
|
}
|
|
|
|
return t;
|
|
}
|
|
|
|
// return transform from source to target (All points/normals must be finite!!!)
|
|
Transform icpPointToPlane(
|
|
const pcl::PointCloud<pcl::PointNormal>::ConstPtr & cloud_source,
|
|
const pcl::PointCloud<pcl::PointNormal>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<pcl::PointNormal> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
return icpPointToPlaneImpl(cloud_source, cloud_target, maxCorrespondenceDistance, maximumIterations, hasConverged, cloud_source_registered, epsilon, icp2D, ransacOutlierRatio, iterationsDone);
|
|
}
|
|
// return transform from source to target (All points/normals must be finite!!!)
|
|
Transform icpPointToPlane(
|
|
const pcl::PointCloud<pcl::PointXYZINormal>::ConstPtr & cloud_source,
|
|
const pcl::PointCloud<pcl::PointXYZINormal>::ConstPtr & cloud_target,
|
|
double maxCorrespondenceDistance,
|
|
int maximumIterations,
|
|
bool & hasConverged,
|
|
pcl::PointCloud<pcl::PointXYZINormal> & cloud_source_registered,
|
|
float epsilon,
|
|
bool icp2D,
|
|
float ransacOutlierRatio,
|
|
int * iterationsDone)
|
|
{
|
|
return icpPointToPlaneImpl(cloud_source, cloud_target, maxCorrespondenceDistance, maximumIterations, hasConverged, cloud_source_registered, epsilon, icp2D, ransacOutlierRatio, iterationsDone);
|
|
}
|
|
|
|
}
|
|
|
|
}
|