社内勉強会にて発表した「肉体言語 Tython」の資料です。 Kinect を使ったプログラミング言語を作りました。 https://github.com/gongo/Tython

1. Tython
Wataru MIYAGUNI
2011-05-13 Fri
. . . . . .

2. Outline
Introduction
Tython Structure
Tython Test Environment
Conclusion
. . . . . .

3. Introduction
Tython
. . . . . .

4. What ?
Body.... Muscle Language
. . . . . .

5. Muscle Language
-
-
• -
. . . . . .

6. Example
( )
. . . . . .

7. Tython is …
• Interface
• Not use keyboard
• Not use mouse
• Use own body ! muscle !
• Programming Style
• Exercise
• No experience welcome !
. . . . . .

8. Demo
YouTube - Tython Hello, World!
. . . . . .

9. ’Hello, World’ source code
. . . . . .

10. Number of typing
191 shots
. . . . . .

11. Takes for success
90 minutes
. . . . . .

12. Impression
Exercise!!
•
•
•
. . . . . .

13. License
MAHALO License (based on MIT License)
Copyright (c) 2011 Wataru MIYAGUNI
( )
•
• ( )
.(
https://github.com/gongo/Tython/raw/development/LICENSE )
. . . . . .

14. Tython Structure
Tython
. . . . . .

15. Structure diagram
. . . . . .

16. Tython Detector
• Kinect
•
. . . . . .

17. Detector Vector
− · − = |− ||− | cos θ
→ →
a b → →
a b
→·−
− →
..
. cos θ =
a b
→||→|
− −
|a b
−
→
− · b = x x +y y +z z
→a 1 2 1 2 1 2
−| =
→
|a x 2+y 2+z 2
1 1 1
. . . . . .

18. PoseDetector
• Kinect ( ) xyz
• ( )
Detect
. . . . . .

19. Tythoh PoseDetector Sample
Tython / src / Detector / OwataPoseDetector.cc
. . . . . .

20. CommandDetector
• PoseDetector
• ->
• Detect
. . . . . .

21. Tython CommandDetector Sample
Tython / src / Detector / LeftJabCommandDetector.cc
. . . . . .

22. InputMethod
Detector
Detector Command input string
LeftJab “a”
RightStraight “@”
RightUpper “g”
LeftHook ““
Detector
Detector Command
Thanks
. . . . . .

23. InputMethod Sample
Tython / src / InputMethod / DefaultInputMethod.cc
. . . . . .

24. Others (Like Typhon)
• Compiler
• Typhon
Typhon Middle language explain
aa#{NUM}g pushNUM add to stack
a@a#{NUM}g copyNUM copy stack value
.. ..
• Typhon
string binary decimal
aa@a@ +0101 5
@@a@a -1010 -10
• VM (Virtual Machine)
Typhon
. . . . . .

25. Source Code Reading
https://github.com/gongo/Tython/tree/development
. . . . . .

26. Future (Other Language)
.NET Framework
. . . . . .

27. IronPython + Tython = ?
IronTython
. . . . . .

28. Future (LocusDetector)
. . . . . .

29. LocusDetector Example
. . . . . .

30. Future (Partner)
( )
. . . . . .

31. Partner Example
. . . . . .

32. Tython Test Environment
Tython
. . . . . .

33. Using Testing Framework
• GoogleTest
• Google C++ Testing Framework
http://code.google.com/p/googletest/
• Google Test
http://opencv.jp/googletestdocs/
. . . . . .

34. GoogleTest Sample 1
ASSERT
TEST_F(VectorTest, TestDot) {
Vector vec1(3.0f, 0.0f, 0.0f);
Vector vec2(0.0f, 1.0f, 0.0f);
Vector vec3(1.0f, 1.0f, 1.0f);
Vector vec4(-12.0f, 0.0f, 0.0f);
ASSERT_EQ( 1.0f, vec1.dot(vec1)); // ( )
ASSERT_EQ( 0.0f, vec1.dot(vec2)); //
ASSERT_LT( 0.0f, vec1.dot(vec3)); //
ASSERT_EQ(-1.0f, vec1.dot(vec4)); // ( )
ASSERT_GT( 0.0f, vec3.dot(vec4)); //
}
. . . . . .

35. GoogleTest Sample 2
/**
*
* 1. push 7 #=> aaaaaag
* 2. push 2 #=> aaa@a@g
* 3. add #=> @aaa stack top 2+7 = 9
* 4. num_out #=> @ a@ stack top
*/
insns = compiler->compile("aaaaaagaaa@a@g@aaa@ a@");
testing::internal::CaptureStdout();
object->run(insns);
ASSERT_STREQ("9", testing::internal::GetCapturedStdout().c_str());
. . . . . .

36. Problem about testing
…
1
.. PoseDetector
•
• (Kinect)
2
.. CommandDetector
• hogehoge
• sleep()
•
• 1,2
• Kinect (30 )
•
. . . . . .

37. GoogleMock
• Google C++ Mocking Framework
http://code.google.com/p/googlemock/
• Google Mock
http://opencv.jp/googlemockdocs/
. . . . . .

38. How?
•
Tython / test / CommandDetectorTest.cc
•
Tython / test / LeftJabCommandDetectorTest.cc
. . . . . .

39. Coverage
http://gongo.github.com/hago/30_tython_coverage/index.html
. . . . . .

40. Conclusion
• Kinect
•
•
•
•
• ( o )
• TDD
• Kinect
•
. . . . . .

41. Finish!!
GKD
(Gongo Kinect Diet)
. . . . . .