Skip to content

YlmzCmlttn

Cemalettin Yılmaz Blog

Menu
  • Home
  • About Me
  • Projects
    • Iot-AR
    • Magnifi-AR
    • Smarthome-IOS
    • Others
  • Categories
    • Articles
    • Augmented Reality
    • Capture The Flag
      • Google CTF
        • 2018
    • Embedded Systems
    • IoT
    • Logisim
    • My Essays
    • Nvidia Jetson
      • Jetson TX1
    • Operating Systems
      • Kali
      • Raspbian
      • Ubuntu
    • Personal
    • Programming
      • Arduino
      • C
      • C#
      • Css
      • Html
      • Js
      • Matlab
      • Node.js
      • Python
      • Swift
      • VHDL
    • Projects
      • Embedded Systems
      • Electric
      • IoT
      • IoT-AR
      • Logisim
      • Magnifi-AR
      • Pose Estimation
    • Raspberry Pi
    • Xilinx
    • Others
Menu

Human Pose Estimation and 3D posing on Unity: Step 1

Posted on March 24, 2018April 25, 2018 by Yılmaz Cemalettin

Step 1: Human Pose Estimation

I mentioned about the Human pose estimations article on this “page” and I clone GitHub repo and everything work fine. For this source code, I create new anaconda environment because I used the different OpenCV version. Also, I didn’t use the Tensorflow GPU. You can use the GPU version it also creates much more estimated results.

Now, Pose estimation is working good but I need the send this key points on the Unity. First of all, I must the understand the code and I understand the which code ‘s results give the key points array. If I can create a connection with Unity also I can create the 3D skeleton with Vuforia for the Augmented Reality

When running the run.py with single photo results like these;

In the run.py code I saw codes I noticed the

Python
1
2
3
import sys
 
sys.exit(0)

 

System close when come to this line and bellow of this code’s purposes are 3D key-points modelling wih matplotlib.

Python
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
logger.info('3d lifting initialization.')
poseLifting = Prob3dPose('./src/lifting/models/prob_model_params.mat')
 
image_h, image_w = image.shape[:2]
standard_w = 640
standard_h = 480
 
pose_2d_mpiis = []
visibilities = []
for human in humans:
pose_2d_mpii, visibility = common.MPIIPart.from_coco(human)
pose_2d_mpiis.append([(int(x * standard_w + 0.5), int(y * standard_h + 0.5)) for x, y in pose_2d_mpii])
visibilities.append(visibility)
 
pose_2d_mpiis = np.array(pose_2d_mpiis)
visibilities = np.array(visibilities)
transformed_pose2d, weights = poseLifting.transform_joints(pose_2d_mpiis, visibilities)
pose_3d = poseLifting.compute_3d(transformed_pose2d, weights)
 
for i, single_3d inenumerate(pose_3d):
plot_pose(single_3d)
plt.show()
 
pass

When I delete sys.exit(0) 3D plot shows up

pose_3d = poseLifting.compute_3d(transformed_pose2d, weights)

pose_3d is the key points of the graph so that if I can send these values with internet to Unity Platform I can move the skeleton based on the human body moving. When I print pose_3d output like that;

 

 

6 thoughts on “Human Pose Estimation and 3D posing on Unity: Step 1”

  1. SK says:
    April 24, 2018 at 8:47 am

    Your posts about Human Pose Estimation and 3D posing on Unity are very helpful for me.But in the process of running, I have 2 problems.When I delete sys.exit(0),3D plot didn’t show.And how to print pose_3d output?Hope to reply me.

    Reply
  2. Yılmaz Cemalettin says:
    April 25, 2018 at 10:38 am

    First of all, are you clone github projects without any problem? I use this github repo If you have any problem to clone repo you can e-mail me ylmzcmlttn@gmail.com

    Reply
  3. http://ironthundersaloon.com says:
    March 7, 2019 at 8:42 pm

    I couldn’t refrain from commenting. Well written!

    Reply
  4. post2015hlp.org says:
    April 15, 2019 at 3:59 pm

    I used to be able to find good information from your
    blog articles. https://www.Post2015hlp.org/

    Reply
  5. how to get help in windows 10 says:
    May 26, 2019 at 6:09 am

    Thanks for one’s marvelous posting! I actually enjoyed reading
    it, you could be a great author. I will make certain to bookmark
    your blog and definitely will come back someday.
    I want to encourage you to continue your great work, have
    a nice holiday weekend!

    Reply
  6. gamefly free trial says:
    May 26, 2019 at 4:31 pm

    What’s up to every , since I am in fact eager of reading this blog’s post to be
    updated on a regular basis. It includes pleasant
    stuff.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

My Motto

“Learn to share, Share to learn”

LinkedIn Badge

Cemalettin Yılmaz

Ads

Archives

Categories

  • Articles (1)
  • Augmented Reality (3)
  • Capture The Flag (23)
    • Google CTF (22)
      • 2018 (13)
      • 2019 (9)
    • PicoCTF (1)
      • 2019 (1)
  • Embedded Systems (3)
  • IoT (3)
  • Logisim (1)
  • My Essays (3)
  • Nvidia Jetson (5)
    • Xavier (5)
  • Operating Systems (24)
    • Kali (3)
    • Raspbian (2)
    • Ubuntu (21)
  • Others (1)
  • Personal (1)
  • Programming (44)
    • Arduino (4)
    • C (10)
    • C# (4)
    • C++ (5)
    • Css (1)
    • CUDA (6)
    • Html (1)
    • Js (2)
    • Libraries (5)
      • OpenCV (3)
      • OpenGL (2)
    • Matlab (14)
    • Node.js (5)
    • Python (6)
    • Swift (3)
  • Programs (4)
    • Tools (4)
  • Projects (21)
    • Books Solutions (8)
    • Electric (2)
    • Embedded Systems (2)
    • Energy Harvesting (1)
    • IoT (2)
    • IoT-AR (1)
    • Logisim (1)
    • Magnifi-AR (3)
    • Pose Estimation (3)
    • Smarthome-Ios (1)
  • Raspberry Pi (3)
  • Uncategorized (2)
  • YZlib (1)

Recent Posts

  • atof stof stod problems with local floating point separator in C/C++
  • Pico CTF 2019 Answers
  • YZlib: Personal C++ Library
  • Drive to target | Google CTF 2019
  • FriendSpaceBookPlusAllAccessRedPremium | Google CTF 2019

Recent Comments

  • AbaShelha on Ghidra Installation on Ubuntu |18.04, 16.04, 14.04
  • Peter on Ghidra Installation on Ubuntu |18.04, 16.04, 14.04
  • Yılmaz Cemalettin on Ghidra Installation on Ubuntu |18.04, 16.04, 14.04
  • Yılmaz Cemalettin on 16-Bit CPU on Logisim
  • Jenny on 16-Bit CPU on Logisim
  • MOON on 16-Bit CPU on Logisim
  • anti on Ghidra Installation on Ubuntu |18.04, 16.04, 14.04
  • hunkerjr on STOP GAN | Google CTF 2019
  • Shaq on 16-Bit CPU on Logisim
  • NURUL AFIQAH MOHD HASBULLAH on 16-Bit CPU on Logisim

Linkedln

© 2022 YlmzCmlttn | Powered by Superbs Personal Blog theme